scriptoriumadmin/featurebase
1
0
Fork 0
mirror of https://github.com/featurebasedb/featurebase.git synced 2026-09-06 00:25:55 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
6478 commits 45 branches 174 tags 85 MiB
Commit graph

6478 commits

This branch
This branch
All branches
Author SHA1 Message Date
Nia Weiss
7ea2e4b7e3
add ID auto-generation on the coordinator 2020-12-03 13:04:14 -05:00
Nia
df13c72351
Merge pull request #1145 from niaow/err-id-on-keyed 
Report an error when an ID is used on a keyed field
 2020-11-25 13:48:04 -05:00
Nia Weiss
353fd3937d
report an error when an ID is used on a keyed field 2020-11-25 11:37:18 -05:00
Alan Bernstein
9e3e0a6be7
Merge pull request #1013 from alanbernstein/query-activity-api 
Add query history endpoint
 2020-11-24 08:46:43 -06:00
Alan Bernstein
65877c1e56 Store start instead of age, skip remote, fix timing bug 2020-11-23 21:31:40 -06:00
Alan Bernstein
0c8e4afe45 Set test nodeIDs to guarantee iteration order in executor 2020-11-23 20:23:28 -06:00
Alan Bernstein
a8a7e53382 Add query-history test 2020-11-23 20:23:28 -06:00
Alan Bernstein
c5a7a259aa Make minor fixes to query tracker 2020-11-23 20:23:28 -06:00
Alan Bernstein
2bc2a32263 Make query history length configurable 2020-11-23 20:23:27 -06:00
Alan Bernstein
b172f4d05b Include index in query history response 2020-11-23 20:23:27 -06:00
Alan Bernstein
542a6ffdb6 Gather query history from remote nodes 2020-11-23 20:23:27 -06:00
Alan Bernstein
bbd147d18f Replace query history map with ringBuffer 2020-11-23 20:23:27 -06:00
Alan Bernstein
65de5df2a9 Update tracker test 2020-11-23 20:23:27 -06:00
Alan Bernstein
c94d242097 Add basic implementation of query history endpoint 2020-11-23 20:23:27 -06:00
seebs
55d0c12703
Merge pull request #1131 from seebs/randomerQuery 
Improve random-query
 2020-11-23 11:58:53 -06:00
Seebs
3d802f428b add Distinct, be more consistent about using correct rand.Rand 
The RandomQueryConfig has its own seeded RNG, but we didn't always use
it (especially in the last two commits, but also I think in one previous
thing), so let's use it more consistently.

We check for int fields (as opposed to decimal), and if we find them,
we add Distinct to our list of potential queries to use if and only
if we've got a depth of at least one so there'd be a child query under
the current query, and if we do, grab one of the int (not decimal)
fields and do a query on that.
 2020-11-23 09:54:59 -06:00
Seebs
796d646a0c handle integer fields 
Extend field handling to include int (and decimal) fields, allowing them
to have range operations specified on them.
 2020-11-23 09:51:29 -06:00
Seebs
2a2a8abbd4 support time fields 
For time fields, allow specifying a range of times, then 19/20 times,
specify "from" and "to" times in that range when querying those fields,
rather than just looking at the standard view all the time.
 2020-11-23 09:51:29 -06:00
Seebs
48b97d6ad4 report QPS after last query 
More generally, report QPS not at 0 queries, which is boring, but every
100 queries *and* after the last query if the last query wasn't at a
multiple of 100 queries. Makes the output slightly more useful, I think.
 2020-11-23 09:51:29 -06:00
Matthew Jaffee
7271fbf396
Merge pull request #1015 from alanbernstein/dont-create-keys-directory 
Check index.keys before opening translate store to avoid unnecessary keys directory
 2020-11-20 14:30:37 -07:00
Matt Jaffee
a48bf28be2
don't try to translate keys on unkeyed indexes 
this causes a few things to error earlier than they otherwise would
have, hence the changed tests.
 2020-11-20 14:48:28 -06:00
Alan Bernstein
063a3b96e3
Check index.keys before opening translate store 2020-11-20 12:43:15 -06:00
Nia
106952dc5e
Merge pull request #1106 from niaow/topk-time 
TopK on time
 2020-11-20 13:24:05 -05:00
Nia
c8ab2a9fb3
Merge branch 'master' into topk-time 2020-11-20 13:11:51 -05:00
Nia Weiss
d7b9568960
add licesnse header to bsi_test.go 2020-11-20 12:40:28 -05:00
Nia Weiss
410a372351
clarify bsi-building preconditions 2020-11-20 12:38:53 -05:00
Nia Weiss
f9c196e418
skip roaring add test in race 
Otherwise it overloads the race detector.
 2020-11-20 12:16:09 -05:00
tgruben
72f4024e99
Merge pull request #1122 from jaten-molecula/inlined_immutable_map_rb 
rbf: use an inlined immutable.Map<uint32, int64> for the PageMap
 2020-11-20 10:44:44 -06:00
Nia Weiss
5d2c42b7bf
address documentation todo in pivotDescending 2020-11-20 11:13:44 -05:00
Matthew Jaffee
64b83137a0
add tests for addBSI 2020-11-20 11:07:30 -05:00
Nia Weiss
46818863e8
implement TopK on time 
This replaces the former TopK BSI building algorithm, as the row cache was too expensive.
Additionally, BSI addition has been optimized with specialized adders inside of roaring.
 2020-11-20 11:06:55 -05:00
Jason E. Aten
e1bb6e303a rbf: use an inlined immutable.Map<uint32, int64> for the PageMap 
- goes 7% faster on kitchen sink import test

- reduces total allocations by 5% on same test.
 2020-11-20 00:49:41 +00:00
jaten-molecula
47202b0ed2
Merge pull request #1095 from molecula/fast-write 
Implement optimized fast leaf write.
 2020-11-19 16:04:31 -06:00
Ben Johnson
a9831ad5a1 Replace literals with leafCellHeaderSize 2020-11-19 14:18:53 -07:00
Ben Johnson
d125c68275 Fix estimated page size calculation to include index padding. 2020-11-19 14:12:43 -07:00
Ben Johnson
33334511c4
Merge branch 'master' into fast-write 2020-11-19 13:44:09 -07:00
jaten-molecula
5b8cda3c88
Merge pull request #1120 from molecula/fix-root-record-overflow 
Fix rbf write root record iterator reset
 2020-11-19 13:11:09 -06:00
Ben Johnson
a31487b873 Fix rbf write root record iterator reset 2020-11-19 11:15:24 -07:00
jaten-molecula
61bdc2257b
Merge pull request #1111 from jaten-molecula/sync_pool 
rbf: reuse cursors with sync.Pool/arena
 2020-11-19 11:17:20 -06:00
Jason E. Aten
9c7bc603af rbf: reuse cursors with sync.Pool or arena 
- the sync.Pool default uses little memory under CI.

- arena approach provides ability to control the maximum memory
  used by rbf Cursors.

- cursor caching is adjustable with --rbf-cursor-cache
  currently 0 by default (meaning use sync.Pool), and
  larger than 0 meaning use an arena of this size.
  With the arena, 20 or less is needed to pass CI.

- rbf test suite runs ~ 4x faster

- kitchen sink ingest test runs 16% faster.

- report TotalAlloc in CALLSTATs

fixes #1105
 2020-11-19 17:02:49 +00:00
jaten-molecula
274a95c4da
Merge pull request #1115 from molecula/remove-rbtree 
Use immutable.SortedMap for root records
 2020-11-19 11:00:57 -06:00
Ben Johnson
26d0e9d958
Merge branch 'master' into remove-rbtree 2020-11-19 07:27:09 -07:00
tgruben
b849fe4b98
Merge pull request #1116 from jaten-molecula/pilosa_txsrc 
use pilosa server --txsrc instead of --tx to prevent viper env var shadowing
 2020-11-18 14:37:10 -06:00
Jason E. Aten
524c78623f repair pilosa/ctl/server_test too 2020-11-18 18:53:22 +00:00
Ben Johnson
0175c66756 Use immutable.SortedMap for root records 
This commit fixes a bug where the root record cache was being
updated in-place causing a race condition with other transactions
using it. The cache implementation has been changed from `rbtree`
to an `immutable.SortedMap`.
 2020-11-18 11:22:52 -07:00
Jason E. Aten
06eb3afaaa use pilosa server --txsrc to prevent viper env var shadowing from stopping PILOSA_TXSRC getting through 2020-11-18 18:21:31 +00:00
jaten-molecula
a9c1ff3047
Merge pull request #1107 from jaten-molecula/fix_tx 
restore the env variable PILOSA_TXSRC's affect
 2020-11-16 17:26:22 -06:00
Jason E. Aten
744827d5cc restore the env variable PILOSA_TXSRC's affect 2020-11-16 23:18:50 +00:00
Ben Johnson
89ae5ad4b7
Merge branch 'master' into fast-write 2020-11-16 09:10:01 -07:00
Ben Johnson
519dc5069d Implement optimized fast leaf write. 
This commit adds an optimized implementation for `putLeafCell()` if
the insert/update will not cause the page to overflow.
 2020-11-16 08:13:35 -07:00