Alan Bernstein
e397d35ed5
Include roaring field and key details in usage endpoint
2021-01-29 17:48:24 -06:00
Jason E. Aten
035073555a
pilosa: only open views with data
...
- Previously, on timequantum schemas, we would
create and open a view for the cartesian
product of every possible view and shard.
- This caused us to be very slow on re-open,
and to use lots of memory for views that
held nothing.
- This change makes startup faster, memory
use much lower, and should speed migration.
2020-12-19 00:03:31 +00:00
Seebs
30d5f891c0
create naive ApplyFilter
2020-12-16 13:16:46 -06:00
Jason E. Aten
b52a814b3c
short_txkey elides index and shard from the txkey
...
- use short_txkey for rbf
- short_txkey breaks a bunch of bolt_test.go, so leave it on (long) txkey for now.
- remove SliceOfShards method from Tx interface
2020-12-11 22:24:56 +00:00
Jason E. Aten
7a9e0969cb
remove lmdb as a Tx backend
...
- test only still uses a Barrier utility from the go-lmdb package;
it could be ported in at some point.
2020-12-04 23:17:59 +00:00
Jason E. Aten
a38d4fa46c
apply --fsync flag to all tx backend
...
- rename from --rbf-fsync to --fsync, as it
now effects bolt, lmdb too.
2020-11-06 18:11:02 +00:00
Jason E. Aten
9c66cd5a81
DeleteEmptyContainer true by default now
2020-10-30 04:15:53 +00:00
Jason E. Aten
509348260f
better migration logging
2020-10-28 22:54:58 +00:00
Jason E. Aten
957cba1768
performance tuning: rbfcfg package, binary search for wal segment
...
- rbfcfg package holds Config for --rbf- command line flags
- wal.go: replace linear search with bisection for wal segment
2020-10-27 00:49:56 +00:00
Jason E. Aten
8d2ad048fa
pilosa server --norowcache disables the row cache
...
- this can lessen memory pressure
- certain backends may not need it
- enables performance benchmarking and tuning
2020-10-22 22:20:48 +00:00
Jason E. Aten
266b92c025
Use boltdb instead of badger as our all Go Tx oracle.
...
- remove all badgerdb code.
- use boltdb instead.
2020-10-16 17:21:21 -05:00
