Nia
a4f538ffec
Merge branch 'master' into pilosa-id-gen
2020-12-07 09:46:58 -05:00
Cody Soyland
fc3b64e500
Add table conversion to duration timing
2020-12-04 15:19:12 -06:00
Cody Soyland
c33eafc27e
Add tests for streaming queries
2020-12-04 15:19:12 -06:00
Cody Soyland
6830657d12
Add query duration to gRPC responses
...
This adds a "duration" parameter to RowResponse and TableResponse, which
will be populated with the query duration in nanoseconds.
For QueryPQLUnary and QuerySQLUnary, the duration is a included in the
returned TableResponse.
For QuerySQL and QueryPQL, only the first RowResponse in the stream will
contain the duration.
2020-12-04 15:19:12 -06:00
Nia Weiss
7ea2e4b7e3
add ID auto-generation on the coordinator
2020-12-03 13:04:14 -05:00
Alan Bernstein
65877c1e56
Store start instead of age, skip remote, fix timing bug
2020-11-23 21:31:40 -06:00
Alan Bernstein
0c8e4afe45
Set test nodeIDs to guarantee iteration order in executor
2020-11-23 20:23:28 -06:00
Alan Bernstein
a8a7e53382
Add query-history test
2020-11-23 20:23:28 -06:00
Alan Bernstein
2bc2a32263
Make query history length configurable
2020-11-23 20:23:27 -06:00
Jason E. Aten
957cba1768
performance tuning: rbfcfg package, binary search for wal segment
...
- rbfcfg package holds Config for --rbf- command line flags
- wal.go: replace linear search with bisection for wal segment
2020-10-27 00:49:56 +00:00
Nia
3b93b767fa
Merge branch 'master' into translate-maybe
2020-10-23 13:59:10 -04:00
Jason E. Aten
8d2ad048fa
pilosa server --norowcache disables the row cache
...
- this can lessen memory pressure
- certain backends may not need it
- enables performance benchmarking and tuning
2020-10-22 22:20:48 +00:00
Nia Weiss
5315579378
add some validation
2020-10-22 10:47:29 -04:00
Seebs
5e36638e10
Supply "subject alternative name" for TLS certificates
...
Go killed off using the common name for hostnames starting with 1.15,
but this can be addressed by recreating the certs using a Subject
Alternative Name for the domain for "localhost". This allows tests
to pass without hanging, at least for me.
2020-10-20 14:14:26 -05:00
Jason E. Aten
275779173d
go1.15.3 support with GODEBUG=x509ignoreCN=0
2020-10-20 12:23:35 -05:00
Cody Soyland
a2ee047868
grpc-web cors test
2020-10-16 11:36:41 -05:00
Cody Soyland
31cd119a7e
Move grpc.Server creation into initializer
...
This fixes an issue with the grpc-web middleware using a nil
grpc.Server instance.
2020-10-16 11:36:41 -05:00
Cody Soyland
04b1152224
Add grpc-web to http handler
2020-10-16 11:36:41 -05:00
Alan Bernstein
ab502a0f8d
Add basic test
2020-10-14 21:11:02 -05:00
Alan Bernstein
2a44bdd25c
Collect size-on-disk usage data from all nodes
2020-10-14 12:20:05 -05:00
Cody Soyland
6c10917ceb
Use vdsm.QueryPQLRequest for vdsm.QueryPQLUnary
2020-10-09 13:34:20 -05:00
Cody Soyland
3039aa44af
Use copy of vdsm InspectRequest for better compatibility
2020-10-09 13:22:24 -05:00
Cody Soyland
a58c345232
Use copy of vdsm QueryPQLRequest for better compatibility
2020-10-09 13:22:24 -05:00
Ben Johnson
7b64abbb53
Reduce default RBF DB size to 4GB; remove race skips
2020-10-06 09:36:31 -06:00
Ben Johnson
c978e2242e
Skip some RBF tests during race detection
2020-10-06 09:36:31 -06:00
Kuba Podgórski
5e2a14400a
Add an extra else branches
2020-10-05 17:13:48 -05:00
Jason Aten
fd87e8d2f3
follow suggestion on https://github.com/molecula/idk/issues/224 , does it fix Q2 delete consumer issue?
...
- apparently not, but this might still be worth doing.
2020-10-05 17:13:48 -05:00
Jason E. Aten
fe425a84c0
pilosa-fsck: scan and repair of pilosa backups
...
- the -fix flag repairs replication errors by copying from the primary.
- the -fixkeys flag repairs any string key translation issues.
- make pilosa-fsck installs pilosa-fsck and builds release-pilosa-fsck.COMMIT.GOOS.tar.gz release tarbar
2020-10-02 16:47:56 -05:00
Alan Bernstein
5705b45864
Add a CLI flag for cluster name and include it in /status response
2020-10-01 10:43:49 -05:00
Alan Bernstein
b6af0e5219
Move usage data to new ui-specific endpoint
2020-10-01 10:25:48 -05:00
Alan Bernstein
474261f12f
Add single-node 'bytesOnDisk' object to /status response
2020-10-01 10:25:48 -05:00
Cody Soyland
949ca882fc
Remove unused helper func
2020-09-29 15:30:12 -05:00
Cody Soyland
fdce92eb40
Use shared types from pilosa proto file and enable generic proxying of query calls
2020-09-29 15:30:12 -05:00
Cody Soyland
83704e7973
Proxy unary methods to Pilosa gRPC handler
2020-09-29 15:29:37 -05:00
Cody Soyland
c1e50ed909
Remove VDS references from pilosa proto file, begin porting VDSM service
2020-09-29 15:29:37 -05:00
Kuba Podgórski
b54a289cd8
Fix holes in grpc response for inspect
2020-09-22 12:02:26 +02:00
Nia Weiss
f03ba0e682
add a deprecation warning to Inspect
2020-09-16 12:30:12 -04:00
Kuba Podgórski
dcc237413e
Merge branch 'master' into fix-writable
2020-09-15 19:14:24 +02:00
Kuba Podgórski
76715a3f9d
Fix TranslateStore writable
2020-09-15 19:09:59 +02:00
Nia Weiss
19e0f3601b
fix type names in PQL Extract and SQL Show
2020-09-15 12:53:21 -04:00
Alan Bernstein
18a593008a
Add simple tests for metrics endpoints
2020-09-14 11:34:59 -05:00
Travis
41e0465eda
Port over VDSM metrics
2020-09-11 16:03:50 -05:00
Jason Aten
2eb097c14d
blue_green migration. holdbkg.go holder goroutine.
...
- blue_green for doing migration. Called before Holder.Open finishes.
- holdbkg.go added for index lookup. Less wedging between a deadlock and a race.
- fix fault under read-only map under lmdb at
TestExecutor_Execute_Row_Range/RowIDColumnID by doing cow in roaring.
- roaring -tags gofuzz builds again
- roaringparanoia build tag added to make test targets in Makefile
- add rbf.NewDBWithAllocZero for out-of-bounds memory checks
- .circleci/config.yml test-shardwidth-22 with large run container, kept OOM-ing we suspect.
Fixes #819
2020-09-11 14:24:15 -05:00
Nia Weiss
6ff224308d
fix inspect panic from incorrect handling of the many types of empty argument
2020-09-09 09:11:21 -04:00
Ben Johnson
150c8a5b06
database per shard, HolderConfig, rbf bit-wise import speedups.
...
- introduce Query Context (Qcx) for managing database-per-shard.
- replaces the MultiTx, so mtx.go is retired and removed.
- introduces the HolderConfig struct and all Holders now have
a path from birth.
- rbf speedups on bitwise writes
- badgerdb is removed due to unresolvable write conflicts.
fixes #703 #676
2020-09-04 13:00:33 -05:00
Nia
219e22cc64
Merge branch 'master' into pg-local-cancel
2020-09-02 14:02:18 -04:00
Travis
32b5826d1a
fix bug on left/right join mapping
2020-09-01 18:22:55 -05:00
Kuba Podgórski
ceb72fc3a9
support null results
2020-09-01 13:00:30 +02:00
Nia Weiss
d421558f58
fix SQL memory leak
2020-08-31 13:10:49 -04:00
Nia Weiss
9f368b06bd
add licesnse header to pg formatter test
2020-08-31 12:42:37 -04:00