Commit graph

702 commits

Author SHA1 Message Date
tgruben
aaa0d4eacf Merge pull request #134 from yuce/dev-docs
added dev docs
2016-11-03 11:27:44 -05:00
Yuce Tekol
59dde04b6d Removed export /home/yuce/Work/pilosa/server lines 2016-11-03 16:55:01 +03:00
Cody Soyland
db6df60877 Merge pull request #133 from yuce/updated-vendor-deps
updated vendors
2016-11-03 08:50:06 -05:00
Yuce Tekol
ef3f40bc9c typo 2016-11-03 16:47:17 +03:00
Yuce Tekol
9e3bfe9d5c typo 2016-11-03 16:45:52 +03:00
Yuce Tekol
64bad3f218 added dev docs 2016-11-03 16:37:45 +03:00
Yuce Tekol
92f0ddb39a updated vendors 2016-11-03 16:14:11 +03:00
tgruben
b2de0e8937 Merge pull request #132 from travisturner/stats
fix the datadog stub so that it compiles without error
2016-11-02 17:21:09 -05:00
Travis
32f0246bf3 fix the datadog stub so that it compiles without error 2016-11-02 16:34:45 -05:00
tgruben
7dbd66baf8 Merge pull request #130 from benbjohnson/check
Add pilosactl check.
2016-10-26 20:34:10 -05:00
Ben Johnson
748484040d
Add pilosactl check. 2016-10-26 13:51:23 -06:00
tgruben
a5502e207e Merge pull request #129 from benbjohnson/127-array-write-fix
Avoid array write if length is zero.
2016-10-26 14:51:21 -05:00
Ben Johnson
65fffc0efa
Avoid array write if length is zero. 2016-10-26 13:47:37 -06:00
tgruben
fe0c83f986 Merge pull request #128 from benbjohnson/stats
Add ExpvarStatsClient and basic tracking.
2016-10-20 16:46:20 -05:00
Ben Johnson
b00901d265
Add ExpvarStatsClient and basic tracking.
A `StatsClient` for `expvar` is added so we can track Stats through
the `/debug/vars` endpoint. Tags are nested inside maps so that we
can see stats for db, frame & slice.

Also added a `MultiStatsClient` for chaining multiple `StatsClient`
implementations together (e.g. `expvar` and DataDog).
2016-10-20 14:35:14 -06:00
tgruben
f20ec5187a Merge pull request #126 from umbel/clearbit_bug
added remote termination clause for clearbit
2016-10-18 15:54:42 -05:00
tgruben
f46f87dc7c Merge pull request #124 from benbjohnson/123-clear-bit-fix
Fix ClearBit() file handle issue.
2016-10-18 15:12:03 -05:00
Todd Gruben
2b6ef06e13 added remote termination clause for clearbit 2016-10-18 15:10:02 -05:00
tgruben
8d27ae9c15 Merge pull request #125 from benbjohnson/123-fix-clear-bit-return
Handle return data from remote ClearBit()
2016-10-18 15:05:40 -05:00
Ben Johnson
a6d77ef580
Handle return data from remote ClearBit()
Previously `ClearBit()` did not handle returned data correctly
and panicked. This change adds it to the list of available return
types.
2016-10-18 11:54:00 -06:00
Ben Johnson
a5dad11131
Fix ClearBit() file handle issue.
Previously the index would create a fragment if it didn't exist
when clearing a bit. This causes additional file handles to be
created when it's already known that the bit is not set.
2016-10-18 10:27:38 -06:00
tgruben
cb5a4176c3 Merge pull request #122 from benbjohnson/120-fix-topn
Add slice to BitmapSegment operations.
2016-10-13 13:04:27 -05:00
Ben Johnson
ab3cdb7e94
Add slice to BitmapSegment operations.
Previously the `slice` was not copied to each new segment when
`Intersect()`, `Union()`, and `Difference()` operations were performed.
This causes issues when those bitmaps were then operated on later such
as performing a `TopN()` on a source bitmap.
2016-10-13 10:54:40 -06:00
tgruben
e553096159 Merge pull request #121 from benbjohnson/statsd
Add StatsClient with DataDog implementation.
2016-10-07 16:03:42 -05:00
Ben Johnson
f41d3adad2
Add StatsClient with DataDog implementation. 2016-10-06 15:11:33 -06:00
tgruben
ce76a8028a Merge pull request #119 from benbjohnson/rmdb
Add endpoint for database deletion.
2016-10-04 13:03:03 -05:00
Ben Johnson
47724584b6
Add endpoint for database deletion.
Executing a request against `DELETE /db` will now delete a database.

	curl -X DELETE "http://localhost:15000/db" -d '{"db":"d"}'
2016-10-04 09:40:59 -06:00
tgruben
dc37402bb0 Merge pull request #118 from benbjohnson/attr-sync
Add profile & bitmap attribute anti-entropy
2016-09-30 13:18:23 -05:00
Ben Johnson
d90a9b97c8
Add profile & bitmap attribute anti-entropy.
Adds block-based anti-entropy for the attribute stores and hooks
into the existing `IndexSyncer` to regulate frequency of syncs.
2016-09-30 11:47:43 -06:00
tgruben
8759d68ab6 Merge pull request #117 from umbel/bug
Bug
2016-09-27 17:20:59 -05:00
Todd Gruben
aa9305ac8d bug in difference 2016-09-27 16:07:48 -05:00
Todd Gruben
dafe954f8e bug in Union 2016-09-27 16:04:20 -05:00
Todd Gruben
a4ccbf869a added docs for TopN attributes 2016-09-27 14:07:29 -05:00
tgruben
24c449b887 Merge pull request #116 from umbel/difference_bug
Difference bug
2016-09-23 16:05:23 -05:00
Todd Gruben
d41f998932 cleaned up constant 2016-09-23 16:04:22 -05:00
Todd Gruben
11a2013f2d fix roaring.Difference crash 2016-09-23 13:27:35 -05:00
Todd Gruben
415507ffe3 fix for intersect and updated tests 2016-09-22 16:47:39 -05:00
Todd Gruben
57810f8ab6 merge 2016-09-22 03:05:53 -05:00
Todd Gruben
f53c2d07d8 merge 2016-09-22 03:05:26 -05:00
tgruben
7c1bf40ff5 Merge pull request #113 from benbjohnson/sort-import
Add import sorting command
2016-09-21 16:30:05 -05:00
Ben Johnson
432bf74368
Add import sorting command.
Introduces new `pilosactl sort` to sort import files by bit
position so they can be inserted faster. Also optimizes container
scanning and adds a `-buffer-size` flag to `import`.
2016-09-21 14:33:24 -06:00
tgruben
1071f193c0 Merge pull request #112 from benbjohnson/import-cache-2
Update cache on Import (alternative)
2016-09-16 15:54:13 -05:00
Ben Johnson
7c07cdf304
Remove import count optimization. 2016-09-16 11:36:54 -06:00
Todd Gruben
3907414a10
cache update on import adjustment 2016-09-16 11:20:31 -06:00
Todd Gruben
3009abbeef
corrected ClearBit 2016-09-16 11:20:12 -06:00
Todd Gruben
60853a6bef
ignore checksum on single node clusters 2016-09-16 11:18:44 -06:00
Todd Gruben
b7780518cc cache update on import adjustment 2016-09-15 13:37:10 -05:00
Todd Gruben
15e425ae8f Merge branch 'master' of github.com:umbel/pilosa 2016-09-13 20:59:23 -05:00
tgruben
84d010e66d Merge pull request #110 from benbjohnson/optimize-top-n
Optimize TopN() w/ source query.
2016-09-13 20:58:53 -05:00
Ben Johnson
947eea4668
Optimize TopN() w/ source query.
This commit makes several changes to optimize the TopN() query:

- Reduce highbits() back from 24-bits to 16-bits.
- Reduce MaxArraySize back from 2^20 to 4096.
- Optimize bitmap count invalidation.
- Parallelize TopN() across nodes.
- Parallelize TopN() across slices.
2016-09-13 14:55:56 -06:00