scriptoriumadmin/featurebase
1
0
Fork 0
mirror of https://github.com/featurebasedb/featurebase.git synced 2026-09-06 08:35:55 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
682 commits 45 branches 174 tags 85 MiB
Commit graph

682 commits

This branch
This branch
All branches
Author SHA1 Message Date
Ben Johnson
a6d77ef580
Handle return data from remote ClearBit() 
Previously `ClearBit()` did not handle returned data correctly
and panicked. This change adds it to the list of available return
types.
 2016-10-18 11:54:00 -06:00
tgruben
cb5a4176c3 Merge pull request #122 from benbjohnson/120-fix-topn 
Add slice to BitmapSegment operations.
 2016-10-13 13:04:27 -05:00
Ben Johnson
ab3cdb7e94
Add slice to BitmapSegment operations. 
Previously the `slice` was not copied to each new segment when
`Intersect()`, `Union()`, and `Difference()` operations were performed.
This causes issues when those bitmaps were then operated on later such
as performing a `TopN()` on a source bitmap.
 2016-10-13 10:54:40 -06:00
tgruben
e553096159 Merge pull request #121 from benbjohnson/statsd 
Add StatsClient with DataDog implementation.
 2016-10-07 16:03:42 -05:00
Ben Johnson
f41d3adad2
Add StatsClient with DataDog implementation. 2016-10-06 15:11:33 -06:00
tgruben
ce76a8028a Merge pull request #119 from benbjohnson/rmdb 
Add endpoint for database deletion.
 2016-10-04 13:03:03 -05:00
Ben Johnson
47724584b6
Add endpoint for database deletion. 
Executing a request against `DELETE /db` will now delete a database.

	curl -X DELETE "http://localhost:15000/db" -d '{"db":"d"}'
 2016-10-04 09:40:59 -06:00
tgruben
dc37402bb0 Merge pull request #118 from benbjohnson/attr-sync 
Add profile & bitmap attribute anti-entropy
 2016-09-30 13:18:23 -05:00
Ben Johnson
d90a9b97c8
Add profile & bitmap attribute anti-entropy. 
Adds block-based anti-entropy for the attribute stores and hooks
into the existing `IndexSyncer` to regulate frequency of syncs.
 2016-09-30 11:47:43 -06:00
tgruben
8759d68ab6 Merge pull request #117 from umbel/bug 
Bug
 2016-09-27 17:20:59 -05:00
Todd Gruben
aa9305ac8d bug in difference 2016-09-27 16:07:48 -05:00
Todd Gruben
dafe954f8e bug in Union 2016-09-27 16:04:20 -05:00
Todd Gruben
a4ccbf869a added docs for TopN attributes 2016-09-27 14:07:29 -05:00
tgruben
24c449b887 Merge pull request #116 from umbel/difference_bug 
Difference bug
 2016-09-23 16:05:23 -05:00
Todd Gruben
d41f998932 cleaned up constant 2016-09-23 16:04:22 -05:00
Todd Gruben
11a2013f2d fix roaring.Difference crash 2016-09-23 13:27:35 -05:00
Todd Gruben
415507ffe3 fix for intersect and updated tests 2016-09-22 16:47:39 -05:00
Todd Gruben
57810f8ab6 merge 2016-09-22 03:05:53 -05:00
Todd Gruben
f53c2d07d8 merge 2016-09-22 03:05:26 -05:00
tgruben
7c1bf40ff5 Merge pull request #113 from benbjohnson/sort-import 
Add import sorting command
 2016-09-21 16:30:05 -05:00
Ben Johnson
432bf74368
Add import sorting command. 
Introduces new `pilosactl sort` to sort import files by bit
position so they can be inserted faster. Also optimizes container
scanning and adds a `-buffer-size` flag to `import`.
 2016-09-21 14:33:24 -06:00
tgruben
1071f193c0 Merge pull request #112 from benbjohnson/import-cache-2 
Update cache on Import (alternative)
 2016-09-16 15:54:13 -05:00
Ben Johnson
7c07cdf304
Remove import count optimization. 2016-09-16 11:36:54 -06:00
Todd Gruben
3907414a10
cache update on import adjustment 2016-09-16 11:20:31 -06:00
Todd Gruben
3009abbeef
corrected ClearBit 2016-09-16 11:20:12 -06:00
Todd Gruben
60853a6bef
ignore checksum on single node clusters 2016-09-16 11:18:44 -06:00
Todd Gruben
b7780518cc cache update on import adjustment 2016-09-15 13:37:10 -05:00
Todd Gruben
15e425ae8f Merge branch 'master' of github.com:umbel/pilosa 2016-09-13 20:59:23 -05:00
tgruben
84d010e66d Merge pull request #110 from benbjohnson/optimize-top-n 
Optimize TopN() w/ source query.
 2016-09-13 20:58:53 -05:00
Ben Johnson
947eea4668
Optimize TopN() w/ source query. 
This commit makes several changes to optimize the TopN() query:

- Reduce highbits() back from 24-bits to 16-bits.
- Reduce MaxArraySize back from 2^20 to 4096.
- Optimize bitmap count invalidation.
- Parallelize TopN() across nodes.
- Parallelize TopN() across slices.
 2016-09-13 14:55:56 -06:00
Todd Gruben
df2ac89558 Merge branch 'master' of github.com:umbel/pilosa 2016-09-07 14:15:10 -05:00
tgruben
7a349fca54 Merge pull request #109 from benbjohnson/opt-int-count 
Optimize IntersectionCount for Array+Bitmap
 2016-09-07 14:14:41 -05:00
Ben Johnson
44540abd1d
Optimize IntersectionCount for Array+Bitmap 
Reworks the `roaring.intersectionCountArrayBitmap()` call to avoid
using an iterator. Performance of the included benchmark went from
2.5ms to 1.1ms.

Some of the issue with intersectionCount is the increased size of
bitmaps and slices and I need to do additional testing with various
sizes.
 2016-09-07 10:13:31 -06:00
Todd Gruben
aea68cbbd8 Merge branch 'master' of github.com:umbel/pilosa 2016-09-01 12:07:27 -05:00
tgruben
361c5fbeb4 Merge pull request #108 from benbjohnson/remove-mmap-resizing 
Remove post-mmap resizing
 2016-09-01 12:06:38 -05:00
Ben Johnson
0879bab148
Remove post-mmap resizing 2016-09-01 09:18:52 -06:00
Todd Gruben
1968972a17 Merge branch 'master' of github.com:umbel/pilosa 2016-08-30 17:36:21 -05:00
Todd Gruben
d4067ef34e corrected ClearBit 2016-08-30 17:36:00 -05:00
tgruben
e130d99a18 Merge pull request #107 from benbjohnson/export 
Add export command to pilosactl
 2016-08-30 17:25:30 -05:00
Ben Johnson
157b7eb966
Add export command to pilosactl 
CSV exports can now be done with the pilosactl application:

	$ pilosactl -d mydb -f myframe -o MYFILE.csv

If `-o` is not specified then the CSV is written to STDOUT. The
exporter combines all slices for the db/frame to into a single
concatenated CSV file.
 2016-08-30 16:18:12 -06:00
Todd Gruben
758bed45ac Merge branch 'master' of github.com:umbel/pilosa 2016-08-26 12:59:55 -05:00
tgruben
f5a32395fc Merge pull request #105 from benbjohnson/optimize-bitmap 
Optimize bitmap with zero copy (WIP)
 2016-08-25 15:33:00 -05:00
Ben Johnson
54f12b655f
Optimize bitmap with zero copy 
Segments bitmaps by slice and changes `Fragment.Bitmap()` to return
bitmaps with segments which are offset ranges of mmapped bitmaps.
 2016-08-25 13:30:25 -06:00
Todd Gruben
6f7031652f Merge branch 'master' of github.com:umbel/pilosa 2016-08-15 18:36:08 -05:00
tgruben
9659f61420 Merge pull request #104 from benbjohnson/count-range 
CountRange()
 2016-08-15 18:35:58 -05:00
Ben Johnson
888040c26c
add CountRange() 
This commit adds `roaring.Bitmap.CountRange()` to return the number
of bits in a subrange of a bitmap. This significantly improves
server start time and is needed for upcoming zero copy bitmap
optimizations.
 2016-08-15 16:03:25 -06:00
Todd Gruben
5eabf67a11 Merge branch 'master' of github.com:umbel/pilosa 2016-08-12 15:10:57 -05:00
Todd Gruben
13f8ce673e cache loading 2016-08-12 15:10:50 -05:00
tgruben
d2106de4c0 Merge pull request #103 from benbjohnson/fix-count-cache 
Fix count() cache retrieval
 2016-08-12 15:06:53 -05:00
Ben Johnson
76af8b53a3
fix count() cache retrieval 2016-08-12 11:02:52 -06:00