scriptoriumadmin/featurebase
1
0
Fork 0
mirror of https://github.com/featurebasedb/featurebase.git synced 2026-09-06 00:25:55 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
696 commits 45 branches 174 tags 85 MiB
Commit graph

696 commits

This branch
This branch
All branches
Author SHA1 Message Date
Yuce Tekol
64bad3f218 added dev docs 2016-11-03 16:37:45 +03:00
tgruben
b2de0e8937 Merge pull request #132 from travisturner/stats 
fix the datadog stub so that it compiles without error
 2016-11-02 17:21:09 -05:00
Travis
32f0246bf3 fix the datadog stub so that it compiles without error 2016-11-02 16:34:45 -05:00
tgruben
7dbd66baf8 Merge pull request #130 from benbjohnson/check 
Add pilosactl check.
 2016-10-26 20:34:10 -05:00
Ben Johnson
748484040d
Add pilosactl check. 2016-10-26 13:51:23 -06:00
tgruben
a5502e207e Merge pull request #129 from benbjohnson/127-array-write-fix 
Avoid array write if length is zero.
 2016-10-26 14:51:21 -05:00
Ben Johnson
65fffc0efa
Avoid array write if length is zero. 2016-10-26 13:47:37 -06:00
tgruben
fe0c83f986 Merge pull request #128 from benbjohnson/stats 
Add ExpvarStatsClient and basic tracking.
 2016-10-20 16:46:20 -05:00
Ben Johnson
b00901d265
Add ExpvarStatsClient and basic tracking. 
A `StatsClient` for `expvar` is added so we can track Stats through
the `/debug/vars` endpoint. Tags are nested inside maps so that we
can see stats for db, frame & slice.

Also added a `MultiStatsClient` for chaining multiple `StatsClient`
implementations together (e.g. `expvar` and DataDog).
 2016-10-20 14:35:14 -06:00
tgruben
f20ec5187a Merge pull request #126 from umbel/clearbit_bug 
added remote termination clause for clearbit
 2016-10-18 15:54:42 -05:00
tgruben
f46f87dc7c Merge pull request #124 from benbjohnson/123-clear-bit-fix 
Fix ClearBit() file handle issue.
 2016-10-18 15:12:03 -05:00
Todd Gruben
2b6ef06e13 added remote termination clause for clearbit 2016-10-18 15:10:02 -05:00
tgruben
8d27ae9c15 Merge pull request #125 from benbjohnson/123-fix-clear-bit-return 
Handle return data from remote ClearBit()
 2016-10-18 15:05:40 -05:00
Ben Johnson
a6d77ef580
Handle return data from remote ClearBit() 
Previously `ClearBit()` did not handle returned data correctly
and panicked. This change adds it to the list of available return
types.
 2016-10-18 11:54:00 -06:00
Ben Johnson
a5dad11131
Fix ClearBit() file handle issue. 
Previously the index would create a fragment if it didn't exist
when clearing a bit. This causes additional file handles to be
created when it's already known that the bit is not set.
 2016-10-18 10:27:38 -06:00
tgruben
cb5a4176c3 Merge pull request #122 from benbjohnson/120-fix-topn 
Add slice to BitmapSegment operations.
 2016-10-13 13:04:27 -05:00
Ben Johnson
ab3cdb7e94
Add slice to BitmapSegment operations. 
Previously the `slice` was not copied to each new segment when
`Intersect()`, `Union()`, and `Difference()` operations were performed.
This causes issues when those bitmaps were then operated on later such
as performing a `TopN()` on a source bitmap.
 2016-10-13 10:54:40 -06:00
tgruben
e553096159 Merge pull request #121 from benbjohnson/statsd 
Add StatsClient with DataDog implementation.
 2016-10-07 16:03:42 -05:00
Ben Johnson
f41d3adad2
Add StatsClient with DataDog implementation. 2016-10-06 15:11:33 -06:00
tgruben
ce76a8028a Merge pull request #119 from benbjohnson/rmdb 
Add endpoint for database deletion.
 2016-10-04 13:03:03 -05:00
Ben Johnson
47724584b6
Add endpoint for database deletion. 
Executing a request against `DELETE /db` will now delete a database.

	curl -X DELETE "http://localhost:15000/db" -d '{"db":"d"}'
 2016-10-04 09:40:59 -06:00
tgruben
dc37402bb0 Merge pull request #118 from benbjohnson/attr-sync 
Add profile & bitmap attribute anti-entropy
 2016-09-30 13:18:23 -05:00
Ben Johnson
d90a9b97c8
Add profile & bitmap attribute anti-entropy. 
Adds block-based anti-entropy for the attribute stores and hooks
into the existing `IndexSyncer` to regulate frequency of syncs.
 2016-09-30 11:47:43 -06:00
tgruben
8759d68ab6 Merge pull request #117 from umbel/bug 
Bug
 2016-09-27 17:20:59 -05:00
Todd Gruben
aa9305ac8d bug in difference 2016-09-27 16:07:48 -05:00
Todd Gruben
dafe954f8e bug in Union 2016-09-27 16:04:20 -05:00
Todd Gruben
a4ccbf869a added docs for TopN attributes 2016-09-27 14:07:29 -05:00
tgruben
24c449b887 Merge pull request #116 from umbel/difference_bug 
Difference bug
 2016-09-23 16:05:23 -05:00
Todd Gruben
d41f998932 cleaned up constant 2016-09-23 16:04:22 -05:00
Todd Gruben
11a2013f2d fix roaring.Difference crash 2016-09-23 13:27:35 -05:00
Todd Gruben
415507ffe3 fix for intersect and updated tests 2016-09-22 16:47:39 -05:00
Todd Gruben
57810f8ab6 merge 2016-09-22 03:05:53 -05:00
Todd Gruben
f53c2d07d8 merge 2016-09-22 03:05:26 -05:00
tgruben
7c1bf40ff5 Merge pull request #113 from benbjohnson/sort-import 
Add import sorting command
 2016-09-21 16:30:05 -05:00
Ben Johnson
432bf74368
Add import sorting command. 
Introduces new `pilosactl sort` to sort import files by bit
position so they can be inserted faster. Also optimizes container
scanning and adds a `-buffer-size` flag to `import`.
 2016-09-21 14:33:24 -06:00
tgruben
1071f193c0 Merge pull request #112 from benbjohnson/import-cache-2 
Update cache on Import (alternative)
 2016-09-16 15:54:13 -05:00
Ben Johnson
7c07cdf304
Remove import count optimization. 2016-09-16 11:36:54 -06:00
Todd Gruben
3907414a10
cache update on import adjustment 2016-09-16 11:20:31 -06:00
Todd Gruben
3009abbeef
corrected ClearBit 2016-09-16 11:20:12 -06:00
Todd Gruben
60853a6bef
ignore checksum on single node clusters 2016-09-16 11:18:44 -06:00
Todd Gruben
b7780518cc cache update on import adjustment 2016-09-15 13:37:10 -05:00
Todd Gruben
15e425ae8f Merge branch 'master' of github.com:umbel/pilosa 2016-09-13 20:59:23 -05:00
tgruben
84d010e66d Merge pull request #110 from benbjohnson/optimize-top-n 
Optimize TopN() w/ source query.
 2016-09-13 20:58:53 -05:00
Ben Johnson
947eea4668
Optimize TopN() w/ source query. 
This commit makes several changes to optimize the TopN() query:

- Reduce highbits() back from 24-bits to 16-bits.
- Reduce MaxArraySize back from 2^20 to 4096.
- Optimize bitmap count invalidation.
- Parallelize TopN() across nodes.
- Parallelize TopN() across slices.
 2016-09-13 14:55:56 -06:00
Todd Gruben
df2ac89558 Merge branch 'master' of github.com:umbel/pilosa 2016-09-07 14:15:10 -05:00
tgruben
7a349fca54 Merge pull request #109 from benbjohnson/opt-int-count 
Optimize IntersectionCount for Array+Bitmap
 2016-09-07 14:14:41 -05:00
Ben Johnson
44540abd1d
Optimize IntersectionCount for Array+Bitmap 
Reworks the `roaring.intersectionCountArrayBitmap()` call to avoid
using an iterator. Performance of the included benchmark went from
2.5ms to 1.1ms.

Some of the issue with intersectionCount is the increased size of
bitmaps and slices and I need to do additional testing with various
sizes.
 2016-09-07 10:13:31 -06:00
Todd Gruben
aea68cbbd8 Merge branch 'master' of github.com:umbel/pilosa 2016-09-01 12:07:27 -05:00
tgruben
361c5fbeb4 Merge pull request #108 from benbjohnson/remove-mmap-resizing 
Remove post-mmap resizing
 2016-09-01 12:06:38 -05:00
Ben Johnson
0879bab148
Remove post-mmap resizing 2016-09-01 09:18:52 -06:00