Commit graph

4977 commits

Author SHA1 Message Date
Seebs
c19b7af0d0
Support direct roaring import operations
We add a new ops log type(pair), AddRoaring and RemoveRoaring,
which set and clear the bits from a provided roaring bitmap.

This also compels us to consider additional sanity checking
during tests.
2019-07-01 13:16:01 -05:00
Seebs
4d1e9ed78a
reshuffle benchmarks and include cache type in testing
It turns out there's some significant potential improvements to
be had in the case where there's no cache being used on a field, so
we add it to the benchmarks, to allow testing that.

We also make sure that `getUpdataInto` picks the requested number
of columns; if N was a point at which something weird happens,
we might only sometimes see it.
2019-07-01 13:16:01 -05:00
seebs
72c6867220
Merge pull request #2026 from seebs/viewRace
view.deleteFragment should hold the lock while altering fragments
2019-06-26 22:01:58 -05:00
Seebs
b2fb51be1f view.deleteFragment should hold the lock while altering fragments
If you delete a fragment while something else is calling allFragments,
you can cause a race. This almost never happens in practice, because
deleting fragments is rare, and the only likely overlap would be with
something like the holder cache flush, which only happens once a
minute. But if you slowed down the rest of the tests enough, and ran
with -race, you might see it.

We check v.fragments directly instead of calling v.Fragment, because
v.Fragment also needs a lock, and we don't want to drop the lock between
the check for existence and the delete operation.
2019-06-26 16:14:37 -05:00
asvetlik
03cb21afbd
Merge pull request #2016 from asvetlik/tests
Test for no containers
2019-06-26 10:48:32 -05:00
asvetlik
f54bb5ed2b
Merge branch 'master' into tests 2019-06-26 10:07:20 -05:00
Shaquille Wyan Que
8ea314ac5e
Merge pull request #2023 from shaqque/fuzz-roaring
Add naive implementations of Roaring and fuzz test
2019-06-26 10:07:03 -05:00
asvetlik
91387ba601
Merge branch 'master' into tests 2019-06-26 09:31:37 -05:00
shaqque
368bb46f45 switched naive_test.go to table driven tests 2019-06-25 17:25:07 -05:00
shaqque
7ba9e18a51 Merge branch 'master' of https://github.com/pilosa/pilosa into fuzz-roaring 2019-06-25 11:22:47 -05:00
shaqque
bc0f86755a added roaringsentinel build tag to check for user errors at build time 2019-06-25 11:16:34 -05:00
asvetlik
8fd603637b
Merge pull request #2021 from asvetlik/master
Malformed Offset Bug in readOffsets and readWithRuns
2019-06-25 10:52:21 -05:00
shaqque
4f8b3f650e added go-fuzz testing for roaring ops vs naive implementation 2019-06-25 10:47:53 -05:00
asvetlik
fb841c3327
Merge branch 'master' into master 2019-06-25 08:10:40 -05:00
Shaquille Wyan Que
8760ed77b2
Merge pull request #2019 from shaqque/2015RoaringBugs
Fix various container iteration bugs in Roaring
2019-06-24 22:03:33 -05:00
Shaquille Wyan Que
46121da00a
Merge branch 'master' into 2015RoaringBugs 2019-06-24 21:33:57 -05:00
shaqque
86e703637b fixed seeking end of run container iteration bug when next container exists and ensure roaringparanoia panics before other ops 2019-06-24 15:18:03 -05:00
Ashley Svetlik
f137f00fe3 Merge branch 'master' of https://github.com/asvetlik/pilosa 2019-06-24 13:05:34 -05:00
Ashley Svetlik
db90b798d7 Merge branch 'master' of https://github.com/asvetlik/pilosa 2019-06-24 13:00:30 -05:00
asvetlik
998e89d9d6
Merge pull request #2 from asvetlik/revert-1-master
Revert "Merge pull request #2017 from asvetlik/master"
2019-06-24 12:59:47 -05:00
asvetlik
3a96315a28
Revert "Merge pull request #2017 from asvetlik/master" 2019-06-24 12:59:31 -05:00
asvetlik
3910c6d08f
Merge pull request #1 from pilosa/master
Merge pull request #2017 from asvetlik/master
2019-06-24 12:57:34 -05:00
Ashley Svetlik
55aa864cac Fixed malformed offset bug in readOffsets 2019-06-24 12:55:32 -05:00
Ashley Svetlik
eb5d1ae1a4 Fixed malformed offset bug in readWithRuns 2019-06-24 12:51:10 -05:00
asvetlik
464cc1d4ed
Merge branch 'master' into tests 2019-06-24 12:31:14 -05:00
asvetlik
b70986bcdb
Merge pull request #2017 from asvetlik/master
Malformed bitmap in pilosa fix
2019-06-24 12:31:00 -05:00
Ashley Svetlik
b0165d7ef9 Revised WithErrors test with err corrections 2019-06-24 12:22:51 -05:00
asvetlik
9c5848daeb
Merge branch 'master' into master 2019-06-24 12:13:52 -05:00
Ashley Svetlik
6b6249b86a Merge branch 'tests' of https://github.com/asvetlik/pilosa into tests 2019-06-24 12:13:06 -05:00
Ashley Svetlik
7ff26194d8 Corrected err and checked for err 2019-06-24 12:11:44 -05:00
asvetlik
250a3f6fbb
Merge branch 'master' into tests 2019-06-24 09:02:52 -05:00
Matthew Jaffee
ab6bed1187
Merge pull request #2020 from jaffee/extra-nodeleave-log
more info if nodeleave confirmation queries fail
2019-06-21 14:53:53 -05:00
Matt Jaffee
c0d067b7ee
move context timeout inside loop, so context gets a fresh deadline 2019-06-21 12:15:58 -05:00
Ashley Svetlik
8fd23239a1 Formatted Fuzz_test.go 2019-06-21 10:09:20 -05:00
Shaquille Wyan Que
a6ba7e339c fix container iteration bugs in roaring 2019-06-20 20:50:58 -05:00
Matt Jaffee
481c85acae
more info if nodeleave confirmation queries fail 2019-06-20 17:32:57 -05:00
Ashley Svetlik
031e23cdea Resolved int overflow 2019-06-20 15:02:18 -05:00
Ashley Svetlik
157e910103 Fuzz_test changes 2019-06-20 14:49:04 -05:00
Ashley Svetlik
873486bc1a Removed no containers pilosa format fix 2019-06-20 14:43:55 -05:00
Ashley Svetlik
18d86a204c Revised test for pilosa roaring no containers 2019-06-20 14:36:38 -05:00
Ashley Svetlik
6943b3c5ba Returned files to original version 2019-06-20 14:35:35 -05:00
Ashley Svetlik
f6d2276a26 Edited openStorage() to make tsts pass 2019-06-19 16:56:49 -05:00
Ashley Svetlik
c8de8b1e21 Returned TestFragment_ClearRow to original 2019-06-19 16:37:26 -05:00
Ashley Svetlik
76b059c48e Got TestFragment_ClearRow() to succeed 2019-06-19 16:17:51 -05:00
asvetlik
f772ca4a34
Merge branch 'master' into master 2019-06-19 14:48:48 -05:00
Ashley Svetlik
ea4950781a Changed roaringData/roaringFileName and made tests work 2019-06-19 14:09:06 -05:00
Ashley Svetlik
cf900e03f9 changed testLoop/testValues and rearranged for loop 2019-06-19 13:54:39 -05:00
Ashley Svetlik
2df44eecfd Implemented previous fixes not present 2019-06-19 13:38:23 -05:00
Ashley Svetlik
656efb4ea6 Fixed fuzz_test.go order to mergability 2019-06-19 13:08:54 -05:00
Ashley Svetlik
8c264d9249 Resolved offical roaring no containers error 2019-06-19 12:59:36 -05:00