Commit graph

951 commits

Author SHA1 Message Date
Travis
0ce5245e5a turn on bitmapCache support in openCache() 2017-03-07 08:34:29 -06:00
Travis
1980978847 fix logic in needsSlices() 2017-03-06 22:20:39 -06:00
Travis
8bb45b8bec Refactor fragment.bitmap() so that it leverages bitmapCache and so that
it's no longer reponsible for updating the count cache.
This commit also helps SetBit/ClearBit performance by allowing them
to work against data from `bitmapCache` instead of loading bitmaps
from fragment.storage every time.
2017-03-06 22:16:37 -06:00
Travis
a42da68899 bug fix in SimpleCache.Fetch (really just reverting my change) 2017-03-06 22:16:37 -06:00
Travis
bfc0e56dc2 move BitmapCache into cache.go. adjust some variable names for clarity 2017-03-06 22:16:37 -06:00
Todd Gruben
e27c1a6d33 rank cache update after count
heap sort order backwards

WIP TopN accuracy

adjusted first phase topn to collect all slices id's

incorrect handling of large topns

cache performance enhancement

fix for failed test TestMain_FrameRestore

remove unused code and fix some variable names
2017-03-06 22:16:36 -06:00
Todd Gruben
23bc227bf3 fix for failed test TestMain_FrameRestore 2017-03-06 22:02:49 -06:00
Todd Gruben
cabe0fef24 cache performance enhancement 2017-03-06 22:02:49 -06:00
Todd Gruben
283dfef1d9 WIP TopN accuracy 2017-03-06 21:59:46 -06:00
Todd Gruben
57122e043f heap sort order backwards 2017-03-06 18:02:59 -06:00
Todd Gruben
29ccab9624 rank cache update after count 2017-03-06 18:02:59 -06:00
Travis
144d64c250 fix BulkAdd comment 2017-03-06 18:02:58 -06:00
Travis
53a8f660a7 add TODO to make MaxIdleConnsPerHost configurable 2017-03-06 18:02:58 -06:00
Travis
34cb92861b remove unused MaxSlice from DB 2017-03-06 18:02:58 -06:00
Travis
307b5884d3 change the names of Simple, turbo to SimpleCache, bitmapCache 2017-03-06 18:02:57 -06:00
Travis
bafdf7744f no longer need to implement Refresh() since that was removed` 2017-03-06 18:02:57 -06:00
Todd Gruben
b1ce3ab751 WIP TopN optimization 2017-03-06 18:02:57 -06:00
Todd Gruben
a21610ed82 handle empty Union/Intersect 2017-03-06 18:02:56 -06:00
Todd Gruben
e7d71a8f47 WIP increase caching and topn adjustments 2017-03-06 18:02:56 -06:00
Todd Gruben
5716006717 top bug in cache refresh 2017-03-06 18:02:55 -06:00
Todd Gruben
a1b9dc05b8 added simple cache to fragment 2017-03-06 18:02:55 -06:00
Todd Gruben
a02716dadb added max slice to schema 2017-03-06 18:02:55 -06:00
Todd Gruben
d61e8e14a4 WIP snapshot optimization 2017-03-06 18:02:54 -06:00
Todd Gruben
0b4f640444 added handling for float attribute 2017-03-06 17:59:16 -06:00
Travis
25e4a681bd add comments to the MaxIdleConnsPerHost tweak 2017-03-06 17:59:16 -06:00
Travis
85a1a71024 run gofmt on the previous commit 2017-03-06 17:59:15 -06:00
Todd Gruben
ce3b797172 limit the number of connections to single host 2017-03-06 17:59:15 -06:00
Todd Gruben
a0d3b67bc8 removed maxslice from setbit path 2017-03-06 17:59:14 -06:00
Travis
7052809504 Adds Todd's performance improvements:
- Ingore asserts in fragment container.
- Only log queries that take longer than 90 seconds.

TODO:
- address the TODOs that make the asserts configurable.
2017-03-06 17:59:14 -06:00
Travis
6518a7381e have roaring clone() return the clone (as opposed to the original) 2017-03-06 17:59:13 -06:00
Travis
f92e880751 handle unionArrayBitmap width of bitmaps correctly 2017-03-06 17:59:12 -06:00
Travis
71d3074b38 for the default version number, include the v 2017-02-03 09:23:15 -06:00
Travis
d0bdea11c5 use the Build parameter as the Version in handler
Standardize on `Version` for the build version
2017-02-02 12:08:03 -06:00
Matthew Jaffee
c2253a36ea Merge pull request #279 from jaffee/264-mktemp
use temp location for pilosactl and pilosa binaries
2017-02-01 13:09:42 -06:00
Linh Vo
a7569a1211 Merge pull request #271 from pilosa/random-pql
execute pql against db on server
2017-01-27 16:07:38 -06:00
Linh Vo
2358e77141 another go fmt 2017-01-27 15:57:01 -06:00
Linh Vo
3c1e262642 gofmt 2017-01-27 15:39:17 -06:00
Linh Vo
5505e713a0 merge master, resolve conflict 2017-01-27 13:59:47 -06:00
Linh Vo
b571812307 default content-type for benchmarks 2017-01-27 13:41:19 -06:00
Linh Vo
254eb8d245 move ExecuteQuery to client that every other benchmark can use 2017-01-27 12:13:17 -06:00
jaffee
8e9ccb0422 use temp location for pilosactl and pilosa binaries
I did it this way instead of using mktemp because
a) mktemp would have created a different filename on every host, which would
make the client side logic much more confusing
b) mktemp isn't guaranteed to be available everywhere, so we're not losing much
by assuming /tmp exists.
2017-01-25 15:17:06 -06:00
Linh Vo
6198acba8e ExecutePQL 2017-01-25 00:17:19 -06:00
Linh Vo
8ddff3235f add pql option to randquery 2017-01-25 00:14:20 -06:00
Matthew Jaffee
dbd633ee2c Merge pull request #270 from pilosa/benchmark-day
Benchmark day
2017-01-23 12:02:00 -06:00
Matthew Jaffee
7ac693ebe6 Merge pull request #275 from jaffee/265-improve-output
add explanatory prints to stderr in pilosactl
2017-01-23 11:49:52 -06:00
jaffee
192a06c1fa add explanatory prints to stderr in pilosactl 2017-01-20 16:55:24 -06:00
Cody Soyland
2275c591dc Merge pull request #269 from codysoyland/zipf-clear
Add ClearBit support to Zipf benchmark
2017-01-20 09:25:19 -06:00
Linh Vo
dd5366889d execute pql against db on server 2017-01-19 22:31:48 -06:00
jaffee
145e75d8ad add docs about Benchmark Name field 2017-01-19 16:54:36 -06:00
Cody Soyland
ca11643a5a Add ClearBit support to Zipf benchmark 2017-01-19 16:41:43 -06:00