Commit graph

8920 commits

Author SHA1 Message Date
Matthew Jaffee
34e742d9c6
Merge pull request #1502 from niaow/fix-more-kv
fix more incorrect uses of KV
2021-03-02 17:50:29 -06:00
Nia Weiss
a698eeaac2
fix more incorrect uses of KV 2021-03-02 18:35:19 -05:00
Matthew Jaffee
b790d2cc5f
Merge pull request #1501 from travisturner/disco-bitdepth-test-fix
fix SaveMeta test; ensure storage backend env is used
2021-03-02 17:26:52 -06:00
Travis
3d10af9d47
fix SaveMeta test; ensure storage backend env is used 2021-03-02 17:19:45 -06:00
Cody Soyland
acc1175c93
Merge pull request #1498 from codysoyland/docker-ci-version
Workaround CI versioning issue
2021-03-02 15:03:52 -06:00
Cody Soyland
0532987d57
Workaround CI versioning issue 2021-03-02 14:39:32 -06:00
Maxton Huff
068325277d
Merge pull request #1465 from Maxtonian/topNfieldequal
Allow "field=" for TopN()
2021-03-02 14:32:25 -06:00
Matthew Jaffee
0568daaa14
Merge pull request #1486 from ajnavarro/disco/remove-unused-code-and-godoc
[DISCO] Add documentation and try to remove code.
2021-03-02 14:07:06 -06:00
Maxton Huff
d61fdc2521
Merge branch 'master' into topNfieldequal 2021-03-02 14:02:58 -06:00
Cody Soyland
d2f391d650
Merge pull request #1496 from codysoyland/docker-build-ci
Docker login prior to building image
2021-03-02 13:59:26 -06:00
Cody Soyland
a94c6cf8a2
Docker login prior to building image 2021-03-02 13:43:27 -06:00
Maxton Huff
d20dc525f5
Merge branch 'master' into topNfieldequal 2021-03-02 13:35:17 -06:00
seebs
2d1d8afdf3
Merge pull request #1490 from seebs/disco1443c
avoid deadlocks or crashes when clients cancel queries
2021-03-02 10:17:24 -06:00
Cody Soyland
0488dbe8d3
Merge pull request #1492 from codysoyland/fix-flags
Fix incorrect build flags
2021-03-02 07:46:07 -06:00
Antonio Navarro Perez
274540ea0b Requested changes
Signed-off-by: Antonio Navarro Perez <antnavper@gmail.com>
2021-03-02 13:46:37 +01:00
Kuba Podgórski
0cb311f2b3 Fix Heartbeat TTL for disco test 2021-03-02 11:30:25 +01:00
Matthew Jaffee
94ccd514ea
Merge branch 'master' into topNfieldequal 2021-03-01 22:18:36 -06:00
Cody Soyland
bfa9682ba5
Fix incorrect build flags 2021-03-01 17:01:06 -06:00
Seebs
5258532157 bump usage guesstimate again
Same machine, a week later: Got 618k instead of 500k. I'm doomed.
2021-03-01 14:20:18 -06:00
Seebs
35d360c68d fix up executor shard-counting logic a bit better
Ensure that mapReduce always waits on its ErrGroup, even if it wants to return
early due to a failure somewhere. Also check logic a bit more carefully on
the error returns; we don't want a transient failure from one node to result
in the whole query failing, we just want it to retry on the next node, so that
shouldn't cancel the whole ErrGroup.
2021-03-01 14:03:49 -06:00
Antonio Navarro Perez
f67db5035e Add part of cache back.
Signed-off-by: Antonio Navarro Perez <antnavper@gmail.com>
2021-03-01 19:09:31 +01:00
Antonio Navarro Perez
50fd72f980
Apply suggestions from code review
Co-authored-by: Travis Turner <travis@pilosa.com>
2021-03-01 18:41:58 +01:00
Antonio Navarro Perez
6f5770bf65 Fix nil pointer exception
Signed-off-by: Antonio Navarro Perez <antnavper@gmail.com>
2021-03-01 18:39:04 +01:00
Maxton Huff
15aa7d1ad8 add field to SetRowAttrs and TopK to prototypes in ast.go 2021-03-01 11:18:31 -06:00
Antonio Navarro Perez
ea7643f8bf Add documentation and try to remove code.
Signed-off-by: Antonio Navarro Perez <antnavper@gmail.com>
2021-03-01 16:25:32 +01:00
Nia
a906a9036b
Merge pull request #1482 from niaow/force-transactional-etcd-reads
Force transactional etcd reads
2021-02-26 19:03:21 -05:00
Travis Turner
4add6134b8
Merge pull request #1468 from travisturner/disco-clustertests
adjust clustertests to have etcd config
2021-02-26 17:49:20 -06:00
seebs
d455fb3105
Merge pull request #1476 from seebs/disco1443b
mapper/mapReduce/worker: always wait for jobs to be finished
2021-02-26 17:35:02 -06:00
Nia Weiss
4be4097edd
force transactional etcd reads 2021-02-26 18:29:01 -05:00
Maxton Huff
23f44725cb remove var allowUnderField 2021-02-26 16:36:16 -06:00
Cody Soyland
c328a18889
Merge pull request #1440 from codysoyland/cd
Add new Docker build process and continuous delivery
2021-02-26 16:32:46 -06:00
Maxton Huff
3822e38952 remove z arg from Rows tests 2021-02-26 16:15:37 -06:00
Travis
ef40bbb617
renew heartbeat lease if the lease expires while a node is unavailable 2021-02-26 16:15:06 -06:00
Travis
d416b88dda
adjust clustertests to have etcd config 2021-02-26 16:15:06 -06:00
Maxton Huff
441630d804 try fixing tests 2021-02-26 16:13:00 -06:00
Nia
590dc3b226
Merge pull request #1478 from niaow/start-http-after-server-open
Start HTTP after server open
2021-02-26 16:04:34 -05:00
Cody Soyland
dca19f7e94
Add new Docker build process and continuous delivery 2021-02-26 14:34:14 -06:00
Seebs
7d15fc2f26 don't reduce errors with non-errors
if we got an error, we don't have to merge it. so either ctx.Err or
resp.err being non-nil means we shouldn't be reducing, but we still need
to grab the responses to make sure we waited for them all.
2021-02-26 14:26:02 -06:00
Nia Weiss
4340e90396
start HTTP handler after server initialization
This fixes a variety of bugs where API requests would read uninitialized state, causing crashes or race conditions.

Co-authored-by: Antonio Navarro Perez <antnavper@gmail.com>
2021-02-26 15:23:47 -05:00
Ben Johnson
eff313d181
Merge pull request #1474 from molecula/bench-autogenerate
Add benchmarking of autogenerated ID data
2021-02-26 12:39:36 -07:00
Nia
d205ea5441
Merge pull request #1442 from niaow/fix-foreignindex-race
Fix a race condition when deferring foreign-index initialization
2021-02-26 14:30:18 -05:00
Maxton Huff
8bc8368c57 change test arguments to be appropriate 2021-02-26 12:58:59 -06:00
Seebs
29fddd40f6 mapper/mapReduce/worker: always wait for jobs to be finished
It's not enough to cancel jobs so their goroutines *will* exit; we have
to be certain that they *have exited* before we finish returning from,
e.g., mapReduce(), or a query can "complete" at a time when there are
still running goroutines accessing data that we're about to invalidate
when we terminate the Qcx.

A better solution would integrate this logic and control into the Qcx
and pass it through everything, rather than having the Qcx bypass
the mapper/mapperLocal and be passed into the mapFn/reduceFn via
closures. But a better solution would be a lot larger.
2021-02-26 12:47:02 -06:00
Maxton Huff
6f76767841 add test in executor.go to compare results of query w/without field= 2021-02-26 12:06:25 -06:00
Ben Johnson
90278b206c Add benchmarking of autogenerated ID data 2021-02-26 10:37:15 -07:00
Maxton Huff
d49a8f953e regenerate pql from modified peg file 2021-02-26 11:27:39 -06:00
Nia
65e4496ea7
Merge pull request #1449 from niaow/deferredcreateshard
Defer cluster messages until startup
2021-02-26 08:13:51 -05:00
Maxton Huff
ab41d0492c add more tests for TopK, Rows, and SetRowAttrs 2021-02-25 16:04:31 -06:00
Nia Weiss
3fbf6993d0
defer cluster messages until startup 2021-02-25 16:01:49 -05:00
Nia Weiss
ca918c187d
fix a race condition when deferring foreign-index initialization 2021-02-25 16:00:56 -05:00