Ben Johnson
bfe570ef9d
Fix deadlock in importWorker()
...
This commit wraps the work for a view in a function so that the
defer on the finisher executes after each view is processed instead
of at the end.
2020-10-12 11:25:28 -06:00
Cody Soyland
279be13a46
Merge pull request #958 from codysoyland/grpc-compat-update
...
Better VDSM gRPC compatibility
2020-10-12 09:27:04 -05:00
Cody Soyland
e40b224a4f
Merge branch 'master' into grpc-compat-update
2020-10-12 09:08:42 -05:00
tgruben
d3811634d6
Merge pull request #959 from molecula/parallel_fsck
...
pilosa-fsck: parallelize Index.ComputeTranslatorSummary
2020-10-09 16:12:36 -05:00
Jason Aten
8da15b18d4
pilosa-fsck: parallelize Index.ComputeTranslatorSummary
...
- add -index option
2020-10-09 15:53:29 -05:00
Cody Soyland
6c10917ceb
Use vdsm.QueryPQLRequest for vdsm.QueryPQLUnary
2020-10-09 13:34:20 -05:00
Cody Soyland
3039aa44af
Use copy of vdsm InspectRequest for better compatibility
2020-10-09 13:22:24 -05:00
Cody Soyland
a58c345232
Use copy of vdsm QueryPQLRequest for better compatibility
2020-10-09 13:22:24 -05:00
tgruben
d3ce4fa70e
Merge pull request #948 from molecula/randomquery
...
pilosa/cmd/random-query: generate random queries from existing schema/data
2020-10-09 12:16:28 -05:00
Jason Aten
937a1afade
pilosa/cmd/random-query: generate random queries from existing schema
...
- fixes molecula/molecula#136
- flag -n 0 does continuous queries until process is killed.
2020-10-08 18:38:01 -05:00
jaten-molecula
06ee8b16ac
Merge pull request #940 from molecula/fsck_2index_repair
...
pilosa-fsck: multi-index counts and repairs.
2020-10-07 07:35:08 -05:00
Jason Aten
a63c6ee2b2
pilosa-fsck: multi-index counts and repairs.
...
- multiple indexes repaired at once could crosstalk. Fixed.
- the counts of keys and ids are now broken down by index.
2020-10-06 21:10:52 -05:00
tgruben
d41de17503
Merge pull request #931 from molecula/fsck_msg
...
pilosa-fsck: correct repair -> analysis in pilosa-fsck logging
2020-10-06 13:21:21 -05:00
jaten-molecula
bc8fc23ac9
Merge branch 'master' into fsck_msg
2020-10-06 13:12:46 -05:00
tgruben
3a742a0caa
Merge pull request #938 from molecula/ci_rbf
...
run CI on rbf and rbf_lmdb
2020-10-06 12:52:33 -05:00
Jason Aten
83f230bbfb
run CI on rbf and rbf_lmdb
2020-10-06 12:22:03 -05:00
Ben Johnson
ab6581446d
Merge pull request #889 from molecula/rbf-immutable-wal
2020-10-06 10:45:47 -06:00
Ben Johnson
3b7758a4f2
Add comment explaining rbf.DB.checkpoint() args
2020-10-06 10:36:57 -06:00
Ben Johnson
2440413c49
Remove test skips based on race detector
2020-10-06 10:29:17 -06:00
Ben Johnson
7b64abbb53
Reduce default RBF DB size to 4GB; remove race skips
2020-10-06 09:36:31 -06:00
Ben Johnson
644969e6a9
Add log.* and tourna.* to gitignore
2020-10-06 09:36:31 -06:00
Ben Johnson
265452cf3d
Add rbf.SyncEnabled
2020-10-06 09:36:31 -06:00
Ben Johnson
cf208cfaa3
Increase test http client timeout
...
The timeout was increased to allow additional time for RBF to process
a lot of individual `Set()` commands in `TestMain_RecalculateHashes`.
2020-10-06 09:36:31 -06:00
Ben Johnson
3852ac79c4
Add rbf.DB.TxN() function and test check
2020-10-06 09:36:31 -06:00
Ben Johnson
c978e2242e
Skip some RBF tests during race detection
2020-10-06 09:36:31 -06:00
Ben Johnson
c51ba69c09
Fix RBF sync calls
2020-10-06 09:36:31 -06:00
Ben Johnson
3429421148
Fix RBF checkpoint off-by-one WAL ID issue
2020-10-06 09:36:31 -06:00
Ben Johnson
d826cec4b3
fix RBF WAL segment reference error
2020-10-06 09:36:31 -06:00
Ben Johnson
cdd10a26f0
Refactor RBF to use immutable list of WAL segments.
...
Previously, RBF shared a list of WAL segments between the DB & Tx.
However, this increased the need for mutexes to access the data.
WAL segments are effectively immutable on-disk so the list of segments
has been refactored so that changes to the segment list are done via
copy-on-write which allows read transactions to access segment data
without a mutex.
The database checkpointing can remove early, unused segments and
there is an update/add check to make sure that Tx segments pushed back
to the DB do not include removed segments.
2020-10-06 09:36:31 -06:00
tgruben
8dbfaf5045
Merge pull request #932 from jaten-molecula/pr919
...
api usage should ignore tx stores. fixes #919
2020-10-06 09:45:43 -05:00
jaten-molecula
ce3a51eb87
Merge branch 'master' into fsck_msg
2020-10-06 09:28:36 -05:00
Jason Aten
6ddeec2ee8
print time at end of fsck run, even if we return 1 to shell
2020-10-06 08:19:53 -05:00
jaten-molecula
4ca42d7f14
Merge branch 'master' into pr919
2020-10-05 21:29:28 -05:00
Travis Turner
12cd4ea69e
Merge pull request #922 from travisturner/design-typos
...
adjust some wording and typos in the fsck design doc
2020-10-05 20:57:44 -05:00
Jason Aten
c82a1593ff
api usage should ignore tx stores. fixes #919
...
- avoid deadlock in txfactory_internal_test w Qcx
2020-10-05 20:51:38 -05:00
Jason Aten
2f9c51349a
correct repair -> analysis in pilosa-fsck logging
2020-10-05 19:59:32 -05:00
Travis Turner
69e15b4719
Merge branch 'master' into design-typos
2020-10-05 18:45:24 -05:00
jaten-molecula
d55ce8723b
Merge pull request #917 from molecula/pr224
...
ensure that Inspect generates a result for every header item
2020-10-05 17:37:15 -05:00
jaten-molecula
a14b81edbf
Merge branch 'master' into design-typos
2020-10-05 17:29:42 -05:00
Kuba Podgórski
5e2a14400a
Add an extra else branches
2020-10-05 17:13:48 -05:00
Jason Aten
fd87e8d2f3
follow suggestion on https://github.com/molecula/idk/issues/224 , does it fix Q2 delete consumer issue?
...
- apparently not, but this might still be worth doing.
2020-10-05 17:13:48 -05:00
Nia
84830d8361
Merge pull request #921 from niaow/fix-rows-type-error
...
Generate errors for all unsupported types in Rows calls
2020-10-05 16:32:37 -04:00
Travis
675373f0f3
adjust some wording and typos in the fsck design doc
2020-10-05 14:38:57 -05:00
Nia Weiss
bb0d8bea14
generate errors for all unsupported types in Rows calls
2020-10-05 15:37:05 -04:00
jaten-molecula
9d7945e5be
Merge pull request #918 from molecula/fsck-design
...
DESIGN.md for pilosa-fsck
2020-10-05 13:36:57 -05:00
Jason E. Aten
05d4b664df
groom
2020-10-05 13:29:29 -05:00
Jason E. Aten
9dacbccf8d
DESIGN.md for pilosa-fsck
...
- Orient users to pilosa-fsck by giving an overview of its operations.
2020-10-05 12:51:26 -05:00
jaten-molecula
75b8fa0aa8
Merge pull request #900 from molecula/pilosa-fsck-rb
...
pilosa-fsck: fsck-like scan and repair of pilosa backups
2020-10-02 16:53:57 -05:00
Jason E. Aten
fe425a84c0
pilosa-fsck: scan and repair of pilosa backups
...
- the -fix flag repairs replication errors by copying from the primary.
- the -fixkeys flag repairs any string key translation issues.
- make pilosa-fsck installs pilosa-fsck and builds release-pilosa-fsck.COMMIT.GOOS.tar.gz release tarbar
2020-10-02 16:47:56 -05:00
jaten-molecula
d9f8de170c
Merge pull request #906 from jaffee/revert-confirm-down-retries
...
retrun confirmDownRetries to 10, tourney mac compatible
2020-10-02 15:15:57 -05:00