Commit graph

8961 commits

Author SHA1 Message Date
pokeeffe-molecula
db81dcd5c1 missed some lines apparently 2022-02-23 11:06:23 -06:00
pokeeffe-molecula
e2b1986504 make it so the autoscaler does not kill us...precious 2022-02-23 10:54:12 -06:00
pokeeffe-molecula
8e96afca9e filter out DEBUG from restore 2022-02-22 22:15:14 -06:00
pokeeffe-molecula
3c72330659 don't fill up the output with progress 2022-02-22 16:43:37 -06:00
pokeeffe-molecula
fba0f67bfa added policy to read write S3 2022-02-22 15:23:39 -06:00
pokeeffe-molecula
b0ea69d2f4 added restore 2022-02-22 13:50:47 -06:00
pokeeffe-molecula
9bc7839dcb moved some stuff around; got test to execute 2022-02-21 08:31:46 -06:00
pokeeffe-molecula
ae0c70d60b interpolate all the js strings 2022-02-17 18:20:05 -06:00
pokeeffe-molecula
9b5a65c35f skip some stuff in the gauntlet we don't need to run 2022-02-17 16:46:03 -06:00
pokeeffe-molecula
dad9bdcae3 Merge branch 'master' into able-perf 2022-02-17 16:26:05 -06:00
pokeeffe-molecula
4b407c10fc works on my machine 2022-02-17 14:29:07 -06:00
pokeeffe-molecula
d8a46f9dfb use dnf instead of apt-get 2022-02-16 21:29:50 -06:00
seebs
c7c04e08a8
Merge pull request #1927 from molecula/fb1210
don't segfault for me, empty distinct results on timestamp field
2022-02-16 17:32:26 -06:00
pokeeffe-molecula
08f5454f6b run it from the shell script 2022-02-16 17:01:41 -06:00
Seebs
2aa10670fb don't segfault for me, empty distinct results on timestamp field
There's an obvious bug, plus another bug that I hit trying to reproduce
the first bug, plus another... it's a long story.

Basically: If you get nothing back from executeDistinctShardBSI on a
Timestamp field, the request for a large enough pool of strings to hold
timestamp conversions of the nothing segfaults because r.Columns() on
a nil row segfaults.

To try to test this better, I added a filter to the executor test that
we use for this case, which got me a different result complaining about
a DistinctTimestamp result not being a SignedRow.

So, there's a couple of issues. One is that, in the case where a filter
is present, if the filter comes up with nothing, we can bail early
and return a result of the SignedRow type, which then breaks the reduce
part of our map/reduce when we try to reduce DistinctTimestamp values
into a SignedRow. To fix this, we make sure that we return the expected
type even in the case where we're bailing early.

A simpler way to see the actual original bug is, rather than having
a filter, just have a shard that has a value in *some other field*
but not in the timestamp field. So we add that to the test, too.

But also, really, since this is a problem that's happened more than
once, I propose that we also just make nil rows allow you to request
their columns and get back nil, so things like this don't bite us as
much. This wouldn't be a sufficient fix for the filter case, and I
still have the short-circuit for the nil row case explicitly in this
particular case because relying on the nil behavior bugs me, but I
think it's safer to allow .Columns on nil rows.
2022-02-16 16:52:00 -06:00
pokeeffe-molecula
1f0799e887 trying again. again. 2022-02-16 14:24:43 -06:00
pokeeffe-molecula
228489eafa omg 2022-02-16 14:10:35 -06:00
pokeeffe-molecula
c9dbb9f3cc again 2022-02-16 14:08:45 -06:00
pokeeffe-molecula
305a046f99 Try again 2022-02-16 13:59:00 -06:00
pokeeffe-molecula
156552f8d4 try deps another way 2022-02-16 13:50:26 -06:00
pokeeffe-molecula
d126b8198f Merge branch 'master' into able-perf 2022-02-16 13:32:08 -06:00
pokeeffe-molecula
55e465ba5c add some retries 2022-02-16 13:23:52 -06:00
pokeeffe-molecula
7610dea65e add the test script 2022-02-16 13:00:35 -06:00
Matthew Jaffee
69a4a0d779
Merge pull request #1924 from molecula/fb-1182-build-on-tags
Fb 1182 build on tags
2022-02-16 11:57:19 -06:00
Matthew Jaffee
e7241ac024 fix tag check to check against null
empty string doesn't work because gitlab doesn't set the variable at
all. How do I know that "null" is correct? Because Fletcher told
me... apparently it's a ruby-ism
2022-02-16 10:51:12 -06:00
Matthew Jaffee
307aefc05e fix up S3 release dump
- remove commit SHA nesting
- add NOTICE, .service files, and .conf
2022-02-16 10:51:12 -06:00
Matthew Jaffee
12a215a006 add separate S3 dump step for tags 2022-02-16 10:51:12 -06:00
pokeeffe-molecula
dca6a27f00 try to get artifacts in child pipeline 2022-02-16 10:46:00 -06:00
seebs
713085918b
Merge pull request #1926 from molecula/FB-1208-crash
[FB-1208] local shadow causing unexpected behavior
2022-02-16 10:33:10 -06:00
Todd Gruben
3668343a01 local shadow causing unexpected behavior 2022-02-16 09:27:52 -06:00
pokeeffe-molecula
16c58db078 now try and set up the cluster 2022-02-16 08:32:39 -06:00
pokeeffe-molecula
0f7990e772 now try and run k6 2022-02-15 20:59:13 -06:00
pokeeffe-molecula
9c3e4a4a8c sudont 2022-02-15 18:39:28 -06:00
pokeeffe-molecula
4a31fe4b2e reordering some stuff 2022-02-15 18:16:00 -06:00
pokeeffe-molecula
e5f85a6f94 try again, again, again 2022-02-15 18:05:55 -06:00
pokeeffe-molecula
65f6239d96 fixing 2022-02-15 16:05:02 -06:00
pokeeffe-molecula
997b8f9b5b remove rules in child 2022-02-15 14:28:12 -06:00
pokeeffe-molecula
53a3573c25 y u no work 2022-02-15 13:14:14 -06:00
pokeeffe-molecula
093de45c06 Merge branch 'master' into able-perf 2022-02-15 12:37:17 -06:00
pokeeffe-molecula
bde8c51f9a try again, again 2022-02-15 12:29:34 -06:00
Ben Johnson
b570a38780
Merge pull request #1925 from molecula/rank-cache-bulk-invalidation
[FB-1206] Periodically invalidate rank cache during bulk add
2022-02-15 10:34:22 -07:00
pokeeffe-molecula
a19cd72e18 install k6 instead of docker 2022-02-15 11:31:12 -06:00
pokeeffe-molecula
a3f2181ed5 takes rules out altogether 2022-02-15 10:39:07 -06:00
pokeeffe-molecula
a8e9e4b9ce try again 2022-02-15 09:59:42 -06:00
pokeeffe-molecula
792121b43e get child pipeline to work 2022-02-15 09:56:38 -06:00
Ben Johnson
6b84d685d5 Periodically invalidate rank cache during bulk add
This commit changes `RankCache.BulkAdd()` so that entries are
limited to an upper bound of 2x `maxEntries`. When this bound
is exceeded then the cache is automatically recalculated.
2022-02-15 08:25:45 -07:00
Matthew Jaffee
6e41c663e0
Merge pull request #1923 from molecula/cicd-will-it-never-end
Cicd will it never end
2022-02-15 08:43:53 -06:00
pokeeffe-molecula
fdb500898d fixed path 2022-02-15 07:59:33 -06:00
pokeeffe-molecula
355b522dac
Merge branch 'master' into cicd-will-it-never-end 2022-02-14 17:22:12 -06:00
pokeeffe-molecula
f97878edcf fixed arch problem 2022-02-14 16:31:55 -06:00