Commit graph

3762 commits

Author SHA1 Message Date
Alan Bernstein
a51f7d66bb Add array-bitmap conversion test 2017-06-19 10:24:17 -05:00
Alan Bernstein
2e540d275c Expand bitmap-run conversion tests 2017-06-19 10:22:20 -05:00
Alan Bernstein
8ee152cbad Use meaningful name for maxBitmap const 2017-06-19 10:18:03 -05:00
Alan Bernstein
60d3887474 Update comments 2017-06-19 10:18:03 -05:00
Alan Bernstein
bff12f5ce1 Add implementations and minimal tests for bitmap-run conversions 2017-06-19 10:18:03 -05:00
Matt Jaffee
ac5f776db9 optimize roaring on snapshot 2017-06-19 10:16:01 -05:00
Matt Jaffee
1a8780c4a2 add bitmapCountRuns and arrayCountRuns 2017-06-19 10:16:01 -05:00
Alan Bernstein
dbee584866 Fixes and tests for array-run conversions 2017-06-19 10:16:01 -05:00
Matt Jaffee
23ce2cd394 unionBitmapRun, bitmapSet/ZeroRange, special case optimization for RLE 2017-06-19 10:13:02 -05:00
Alan Bernstein
343e35f123 Update TestUnionArrayRun for array result case 2017-06-19 10:13:02 -05:00
Alan Bernstein
22393014cd Implement run/array conversion functions 2017-06-19 10:13:02 -05:00
Matt Jaffee
32c3b2ad52 more cardinality and conversions 2017-06-19 10:13:02 -05:00
Matt Jaffee
487a369c6d more cardinality tracking and tests 2017-06-19 10:13:02 -05:00
Matt Jaffee
88e0e4d5b6 cleanup - setting cardinality and conversions 2017-06-19 10:13:02 -05:00
Matt Jaffee
c17c737264 be smarter about setting output.n 2017-06-19 10:13:02 -05:00
Matt Jaffee
8ec8fc556c intersectRunRun to use runAppendInterval
this avoid situations where two runs which are adjacent don't get collapsed to a
single run
2017-06-19 10:13:02 -05:00
Matt Jaffee
97346baa94 unionArrayRun implementation 2017-06-19 10:13:02 -05:00
Matt Jaffee
c5a0f23257 clean up unionRunRun 2017-06-19 10:13:02 -05:00
Matt Jaffee
4848a99aca unionRunRun working - messy 2017-06-19 10:13:02 -05:00
Matt Jaffee
24c03f07f6 add note to improve intersectRunRun func 2017-06-19 10:13:02 -05:00
Matt Jaffee
cf445f8012 stub out the rest of the rle methods 2017-06-19 10:13:02 -05:00
Matt Jaffee
9781a4c78b fix tests, prep for union rle implementations 2017-06-19 10:13:02 -05:00
Matt Jaffee
250e8f6f5b implement intersectBitmapRun
wowza
2017-06-19 10:13:02 -05:00
Matt Jaffee
8954a6ae8c fix bitmapCountRange and test
had been thinking that index 0 was the most significant bit, but based on the
bitmapAdd function, it must be the least significant bit
2017-06-19 10:13:02 -05:00
Matt Jaffee
3e8030aee4 implement intersectRunRun 2017-06-19 10:10:57 -05:00
Matt Jaffee
0c3f61a426 implement intersectArrayRun 2017-06-19 10:10:57 -05:00
Matt Jaffee
20cec1363b implement intersectionCounts for run containers 2017-06-19 10:10:57 -05:00
Matt Jaffee
014005b5d5 when choosing between container types, keep bitmap as default 2017-06-19 10:06:11 -05:00
Matt Jaffee
95b55ee7db use uint32 instead of uint16 for rle containers
stays consistent with the array type containers. array and rle are using uint32
in case we want to change the size of roaring containers as an optimization.
This has been done in the past
a8feb985e1

The downside is that more storage is used, so we may want to convert to uint16
until we decide to play with that optimization again, but for now I'll keep the
rle implementation in sync with the array implementation.
2017-06-19 10:06:11 -05:00
Matt Jaffee
98c8fd1ded rename conversion funcs to prepare for rle
also support rle in clone()
2017-06-19 10:06:11 -05:00
Matt Jaffee
e80812cb0a implement runMax 2017-06-19 10:06:11 -05:00
Matt Jaffee
72b6eb45e5 add runRemove 2017-06-19 10:06:11 -05:00
Matt Jaffee
c2203d19c1 wip on adding RLE to roaring, add, countRange, contains 2017-06-19 10:03:55 -05:00
Linh Vo
01d51ac97c Merge pull request #648 from raskle/input-definition
Broadcast Delete InputDefinition Messages and handle on remote nodes.
2017-06-16 16:56:38 -05:00
Michael Baird
b7ac8eda71 add comments 2017-06-16 14:33:33 -05:00
Travis
431fcbbe4b
Put the handler endpoints in alphabetical order.
Made the InputDefinition handler function names more descriptive.
2017-06-16 14:25:16 -05:00
Michael Baird
428b94dd05 Broadcast Delete InputDefinition Messages and handle on remote nodes. 2017-06-16 14:06:46 -05:00
Linh Vo
7a78fbd440 Merge pull request #643 from raskle/input-definition
Use the internal.inputdefinition
2017-06-16 13:37:41 -05:00
Michael Baird
8c8f863943 reverted the broadcaster handler for internal.CreateFrameMessage 2017-06-16 13:25:45 -05:00
Michael Baird
64b51f3bc3 Use the internal.inputdefinition object for broadcasting to other nodes. Create encoding methods to translate the JSON request to create a definition. 2017-06-15 23:45:19 -05:00
Michael Baird
ddb4adcc47 Merge pull request #636 from raskle/429-stats-file-descriptor
Count open file handles as a StatsD metric.
2017-06-15 10:03:55 -05:00
Linh Vo
e72e3dc436 more handle tests 2017-06-15 00:39:21 -05:00
Michael Baird
00dec45e58 Input definition "Fields" parameter name is consistent throughout now. 2017-06-14 14:23:25 -05:00
Michael Baird
1db97b9312 CreateInputDefinitionMessage now contains the definition and not just the name. 2017-06-14 14:12:07 -05:00
Cody Soyland
7f17b3791d Merge pull request #635 from codysoyland/makefile-coverage
Add coverage tools to Makefile
2017-06-14 14:50:48 -04:00
Michael Baird
87f2940233 declare multiple values in the same switch case 2017-06-14 09:26:13 -05:00
Michael Baird
cd532e08cb Add -b option to lsof to avoid kernel blocks. 2017-06-13 16:14:45 -05:00
Linh Vo
2d3f244a7b couple more tests 2017-06-13 13:56:08 -05:00
Linh Vo
5ce6b5d684 CreateInputDefinition tests 2017-06-13 10:14:14 -05:00
Linh Vo
ea53216ff2 expose input definition frames, fields 2017-06-12 23:43:03 -05:00