Commit graph

8982 commits

Author SHA1 Message Date
Samir Patel
05e98ee678 Check "like" argument applied to keyed fields
Check if queries that have a 'like' argument are applied to keyed
fields. If not, log that the user is trying to use 'like' on an
unsupported field type (as opposed to reporting that there
are no results.)
2022-02-25 16:54:19 -06:00
reesporte
872eb99b9d
Merge pull request #1933 from molecula/data-race-begone
fix some data races
2022-02-25 16:15:47 -06:00
reesporte
45633e23a5 only set bits after the holder is completely setup
This should help prevent a data race. SetBit can, in some cases, cause an
asynchronous task to run which tries to update the stats counter.

But if that task runs while we are modifying the stats counter itself, we have a
data race.
2022-02-25 15:02:24 -06:00
reesporte
6b23925bd7 improve Server WaitGroup concurrent usage
Add a lock to the Server WaitGroup so that if the Server WaitGroup is already
waiting, we won't concurrently add to it and cause a data race.

Also, when adding to the Server WaitGroup, check that the server is not closing
already, since that means we really shouldn't be doing more work.
2022-02-25 15:02:21 -06:00
souhailanoor
4e2eeaf1e9
Merge pull request #1938 from molecula/fb1186
FB-1186: Recover if delete was not completed
2022-02-25 13:07:50 -06:00
Souhaila Noor
574c404a66 addressed review comments 2022-02-25 11:06:06 -06:00
souhailanoor
8890f3ed06
Merge branch 'master' into fb1186 2022-02-25 10:41:27 -06:00
tgruben
f0dc484044
Merge pull request #1941 from molecula/fb-1214
[FB-1214] Fix RBF recovery when using methodical meta page detection
2022-02-25 09:55:21 -06:00
Souhaila Noor
8a95ac344b We check for incomplete deletion when server is started.
When deletion is started, _exists field is updated with row+1.
After deletion is completed, we delete _exists=row+1.
If _exists>=1, then deletion was not completed.

Updated go version in docker to match other requirements.
Removed duplicate error check for grpc.
2022-02-25 09:28:13 -06:00
tgruben
7d07b47350
Merge branch 'master' into fb-1214 2022-02-25 09:10:42 -06:00
pokeeffe-molecula
9909adbd05
Merge pull request #1940 from molecula/able-perf
added an aggregate into the test
2022-02-25 08:52:52 -06:00
pokeeffe-molecula
a1fca4ce3c take out political_party 2022-02-24 19:46:03 -06:00
pokeeffe-molecula
2fb6799565 extend the job timeout 2022-02-24 18:01:07 -06:00
Ben Johnson
28c41e9b4d Fix RBF recovery when using methodical meta page detection 2022-02-24 16:05:12 -07:00
pokeeffe-molecula
83485aa63a added an aggregate into the test 2022-02-24 16:33:02 -06:00
pokeeffe-molecula
c9368d5e7a
Merge pull request #1932 from molecula/able-perf
Able perf
2022-02-24 12:56:19 -06:00
pokeeffe-molecula
4fef282416 removed tfstate.backup files 2022-02-24 10:24:27 -06:00
pokeeffe-molecula
d6210e2421 Merge branch 'master' into able-perf 2022-02-23 14:16:44 -06:00
pokeeffe-molecula
a07264a8d1 split untar and restore 2022-02-23 13:12:03 -06:00
pokeeffe-molecula
db81dcd5c1 missed some lines apparently 2022-02-23 11:06:23 -06:00
pokeeffe-molecula
e2b1986504 make it so the autoscaler does not kill us...precious 2022-02-23 10:54:12 -06:00
seebs
94cfecf0d3
Merge pull request #1930 from molecula/fb1207
[FB-1207] catch the panic we throw for an invalid timestamp
2022-02-23 10:11:02 -06:00
pokeeffe-molecula
8e96afca9e filter out DEBUG from restore 2022-02-22 22:15:14 -06:00
pokeeffe-molecula
3c72330659 don't fill up the output with progress 2022-02-22 16:43:37 -06:00
Seebs
6d93e41e7f catch the panic we throw for an invalid timestamp
We recover from some specific panics deeper in the PEG parser, but when
we added the invalid timestamp, we didn't add it to the list we catch
and handle gracefully. Add test case for this, and test case for
successful parsing. Also add the word "valid" to the error message so
people don't get as confused by it.
2022-02-22 16:20:09 -06:00
pokeeffe-molecula
fba0f67bfa added policy to read write S3 2022-02-22 15:23:39 -06:00
pokeeffe-molecula
b0ea69d2f4 added restore 2022-02-22 13:50:47 -06:00
pokeeffe-molecula
9bc7839dcb moved some stuff around; got test to execute 2022-02-21 08:31:46 -06:00
pokeeffe-molecula
ae0c70d60b interpolate all the js strings 2022-02-17 18:20:05 -06:00
pokeeffe-molecula
9b5a65c35f skip some stuff in the gauntlet we don't need to run 2022-02-17 16:46:03 -06:00
pokeeffe-molecula
dad9bdcae3 Merge branch 'master' into able-perf 2022-02-17 16:26:05 -06:00
pokeeffe-molecula
4b407c10fc works on my machine 2022-02-17 14:29:07 -06:00
pokeeffe-molecula
d8a46f9dfb use dnf instead of apt-get 2022-02-16 21:29:50 -06:00
seebs
c7c04e08a8
Merge pull request #1927 from molecula/fb1210
don't segfault for me, empty distinct results on timestamp field
2022-02-16 17:32:26 -06:00
pokeeffe-molecula
08f5454f6b run it from the shell script 2022-02-16 17:01:41 -06:00
Seebs
2aa10670fb don't segfault for me, empty distinct results on timestamp field
There's an obvious bug, plus another bug that I hit trying to reproduce
the first bug, plus another... it's a long story.

Basically: If you get nothing back from executeDistinctShardBSI on a
Timestamp field, the request for a large enough pool of strings to hold
timestamp conversions of the nothing segfaults because r.Columns() on
a nil row segfaults.

To try to test this better, I added a filter to the executor test that
we use for this case, which got me a different result complaining about
a DistinctTimestamp result not being a SignedRow.

So, there's a couple of issues. One is that, in the case where a filter
is present, if the filter comes up with nothing, we can bail early
and return a result of the SignedRow type, which then breaks the reduce
part of our map/reduce when we try to reduce DistinctTimestamp values
into a SignedRow. To fix this, we make sure that we return the expected
type even in the case where we're bailing early.

A simpler way to see the actual original bug is, rather than having
a filter, just have a shard that has a value in *some other field*
but not in the timestamp field. So we add that to the test, too.

But also, really, since this is a problem that's happened more than
once, I propose that we also just make nil rows allow you to request
their columns and get back nil, so things like this don't bite us as
much. This wouldn't be a sufficient fix for the filter case, and I
still have the short-circuit for the nil row case explicitly in this
particular case because relying on the nil behavior bugs me, but I
think it's safer to allow .Columns on nil rows.
2022-02-16 16:52:00 -06:00
pokeeffe-molecula
1f0799e887 trying again. again. 2022-02-16 14:24:43 -06:00
pokeeffe-molecula
228489eafa omg 2022-02-16 14:10:35 -06:00
pokeeffe-molecula
c9dbb9f3cc again 2022-02-16 14:08:45 -06:00
pokeeffe-molecula
305a046f99 Try again 2022-02-16 13:59:00 -06:00
pokeeffe-molecula
156552f8d4 try deps another way 2022-02-16 13:50:26 -06:00
pokeeffe-molecula
d126b8198f Merge branch 'master' into able-perf 2022-02-16 13:32:08 -06:00
pokeeffe-molecula
55e465ba5c add some retries 2022-02-16 13:23:52 -06:00
pokeeffe-molecula
7610dea65e add the test script 2022-02-16 13:00:35 -06:00
Matthew Jaffee
69a4a0d779
Merge pull request #1924 from molecula/fb-1182-build-on-tags
Fb 1182 build on tags
2022-02-16 11:57:19 -06:00
Matthew Jaffee
e7241ac024 fix tag check to check against null
empty string doesn't work because gitlab doesn't set the variable at
all. How do I know that "null" is correct? Because Fletcher told
me... apparently it's a ruby-ism
2022-02-16 10:51:12 -06:00
Matthew Jaffee
307aefc05e fix up S3 release dump
- remove commit SHA nesting
- add NOTICE, .service files, and .conf
2022-02-16 10:51:12 -06:00
Matthew Jaffee
12a215a006 add separate S3 dump step for tags 2022-02-16 10:51:12 -06:00
pokeeffe-molecula
dca6a27f00 try to get artifacts in child pipeline 2022-02-16 10:46:00 -06:00
seebs
713085918b
Merge pull request #1926 from molecula/FB-1208-crash
[FB-1208] local shadow causing unexpected behavior
2022-02-16 10:33:10 -06:00