Matthew Jaffee
280b245be7
Merge pull request #645 from jaffee/v0.2
...
rewrite intersectCountArrayBitmap for perf test
2017-06-16 13:29:29 -05:00
Matt Jaffee
7ec88e2f67
rewrite intersectCountArrayBitmap for perf test
2017-06-16 11:29:18 -05:00
Matthew Jaffee
79cd821102
Merge pull request #566 from pilosa/bitmapCountRangev0.2
...
Bitmap count rangev0.2
2017-05-22 11:00:52 -05:00
Matt Jaffee
eae9d5c7f6
remove branch and always count last container
2017-05-22 10:49:26 -05:00
Matt Jaffee
022d84e8aa
fix offset check to make sense
2017-05-22 10:49:08 -05:00
Matt Jaffee
bc49ffb162
fix bitmapCountRange and test
...
had been thinking that index 0 was the most significant bit, but based on the
bitmapAdd function, it must be the least significant bit
2017-05-22 10:48:57 -05:00
Matt Jaffee
0cc2f9eb71
fix 3 separate bugs in bitmapCountRange
...
in order of the diff:
1. When the start and end of the range fall in the same word, special handling
is needed to "mask" off the beginning and end of the word simultaneously to
avoid counting bits at the beginning or end of the word that aren't in the
range.
2. `i++` is needed at the end of the first partial word to avoid counting this
word in the next block.
3. the shift amount for right shifts is 64 - (end % 64) rather than just end
% 64. If end is (e.g.) 68, then 68 - 64 is 4 and we are only interested in the
first 4 bits of the word, so we must right shift by 60 bits, not 4 bits.
2017-05-22 10:48:45 -05:00
Travis Turner
bee56fd2d6
Merge pull request #536 from travisturner/v0.2-filter-node
...
Add Cluster.UnavailableNodes support to skip reads on certain nodes (for v0.2).
2017-05-08 21:24:31 -05:00
Travis
65760496fe
Add Cluster.UnavailableNodes support to skip reads on certain nodes.
2017-05-08 12:46:26 -05:00
Travis Turner
99d930ce64
Merge pull request #380 from travisturner/v0.2-top-n
...
Move the top-n `trim` performance enhancement over to the v0.2 branch.
2017-03-09 09:34:58 -06:00
Travis
d02b823ba3
Move the top-n trim performance enhancement over to the v0.2 branch.
2017-03-08 16:36:11 -06:00
Travis
0ce5245e5a
turn on bitmapCache support in openCache()
2017-03-07 08:34:29 -06:00
Travis
1980978847
fix logic in needsSlices()
2017-03-06 22:20:39 -06:00
Travis
8bb45b8bec
Refactor fragment.bitmap() so that it leverages bitmapCache and so that
...
it's no longer reponsible for updating the count cache.
This commit also helps SetBit/ClearBit performance by allowing them
to work against data from `bitmapCache` instead of loading bitmaps
from fragment.storage every time.
2017-03-06 22:16:37 -06:00
Travis
a42da68899
bug fix in SimpleCache.Fetch (really just reverting my change)
2017-03-06 22:16:37 -06:00
Travis
bfc0e56dc2
move BitmapCache into cache.go. adjust some variable names for clarity
2017-03-06 22:16:37 -06:00
Todd Gruben
e27c1a6d33
rank cache update after count
...
heap sort order backwards
WIP TopN accuracy
adjusted first phase topn to collect all slices id's
incorrect handling of large topns
cache performance enhancement
fix for failed test TestMain_FrameRestore
remove unused code and fix some variable names
2017-03-06 22:16:36 -06:00
Todd Gruben
23bc227bf3
fix for failed test TestMain_FrameRestore
2017-03-06 22:02:49 -06:00
Todd Gruben
cabe0fef24
cache performance enhancement
2017-03-06 22:02:49 -06:00
Todd Gruben
283dfef1d9
WIP TopN accuracy
2017-03-06 21:59:46 -06:00
Todd Gruben
57122e043f
heap sort order backwards
2017-03-06 18:02:59 -06:00
Todd Gruben
29ccab9624
rank cache update after count
2017-03-06 18:02:59 -06:00
Travis
144d64c250
fix BulkAdd comment
2017-03-06 18:02:58 -06:00
Travis
53a8f660a7
add TODO to make MaxIdleConnsPerHost configurable
2017-03-06 18:02:58 -06:00
Travis
34cb92861b
remove unused MaxSlice from DB
2017-03-06 18:02:58 -06:00
Travis
307b5884d3
change the names of Simple, turbo to SimpleCache, bitmapCache
2017-03-06 18:02:57 -06:00
Travis
bafdf7744f
no longer need to implement Refresh() since that was removed`
2017-03-06 18:02:57 -06:00
Todd Gruben
b1ce3ab751
WIP TopN optimization
2017-03-06 18:02:57 -06:00
Todd Gruben
a21610ed82
handle empty Union/Intersect
2017-03-06 18:02:56 -06:00
Todd Gruben
e7d71a8f47
WIP increase caching and topn adjustments
2017-03-06 18:02:56 -06:00
Todd Gruben
5716006717
top bug in cache refresh
2017-03-06 18:02:55 -06:00
Todd Gruben
a1b9dc05b8
added simple cache to fragment
2017-03-06 18:02:55 -06:00
Todd Gruben
a02716dadb
added max slice to schema
2017-03-06 18:02:55 -06:00
Todd Gruben
d61e8e14a4
WIP snapshot optimization
2017-03-06 18:02:54 -06:00
Todd Gruben
0b4f640444
added handling for float attribute
2017-03-06 17:59:16 -06:00
Travis
25e4a681bd
add comments to the MaxIdleConnsPerHost tweak
2017-03-06 17:59:16 -06:00
Travis
85a1a71024
run gofmt on the previous commit
2017-03-06 17:59:15 -06:00
Todd Gruben
ce3b797172
limit the number of connections to single host
2017-03-06 17:59:15 -06:00
Todd Gruben
a0d3b67bc8
removed maxslice from setbit path
2017-03-06 17:59:14 -06:00
Travis
7052809504
Adds Todd's performance improvements:
...
- Ingore asserts in fragment container.
- Only log queries that take longer than 90 seconds.
TODO:
- address the TODOs that make the asserts configurable.
2017-03-06 17:59:14 -06:00
Travis
6518a7381e
have roaring clone() return the clone (as opposed to the original)
2017-03-06 17:59:13 -06:00
Travis
f92e880751
handle unionArrayBitmap width of bitmaps correctly
2017-03-06 17:59:12 -06:00
Travis
71d3074b38
for the default version number, include the v
2017-02-03 09:23:15 -06:00
Travis
d0bdea11c5
use the Build parameter as the Version in handler
...
Standardize on `Version` for the build version
2017-02-02 12:08:03 -06:00
Matthew Jaffee
c2253a36ea
Merge pull request #279 from jaffee/264-mktemp
...
use temp location for pilosactl and pilosa binaries
2017-02-01 13:09:42 -06:00
Linh Vo
a7569a1211
Merge pull request #271 from pilosa/random-pql
...
execute pql against db on server
2017-01-27 16:07:38 -06:00
Linh Vo
2358e77141
another go fmt
2017-01-27 15:57:01 -06:00
Linh Vo
3c1e262642
gofmt
2017-01-27 15:39:17 -06:00
Linh Vo
5505e713a0
merge master, resolve conflict
2017-01-27 13:59:47 -06:00
Linh Vo
b571812307
default content-type for benchmarks
2017-01-27 13:41:19 -06:00
