Commit graph

8819 commits

Author SHA1 Message Date
Matthew Jaffee
70ea784d41 don't mind me, just submitting stuff that doesn't even compile and
then getting confused by linter errors
2022-02-02 20:56:18 -06:00
Matthew Jaffee
69c00a92ad remove a bunch of roaring backend stuff
snapshotQueue, op tracking, roaring-only tests
2022-02-02 20:56:18 -06:00
Matthew Jaffee
fa4855c887 remove unnecessary filter 2022-02-02 20:56:18 -06:00
Matthew Jaffee
e471b462b6 remove all occurences of Bitmap.Source 2022-02-02 20:56:18 -06:00
Matthew Jaffee
f8b180a4a5
Merge pull request #1900 from molecula/fix-clustertests
get container ID via "docker-compose" call in clustertests
2022-02-02 16:27:23 -06:00
Matthew Jaffee
979023392d authclustertests wasn't working because...
weirdness with the docker-compose file being in a different directory,
I think.
2022-02-02 15:08:04 -06:00
Matthew Jaffee
61783e5827 add option to set ResponseHeaderTimeout per client
this is necessary as in some cases we want a low timeout (when we
expect a quick response, e.g. with backup), but in others we may want
a very long timeout (long running query).

Now we have more granular control over timeouts so we can get things
to fail more predictably in tests.
2022-02-02 14:04:40 -06:00
Matthew Jaffee
06235c3d70 get container ID via "docker-compose" call in clustertests
this should be a lot more reliable than trying to construct it based
on the project name as the exact construction can differ between
docker-compose versions.

There was also an issue with the backups succeeding when they should
fail in the test. There's an arcane maze of HTTP timeouts to navigate
here, but basically there are situations where the client will just
wait forever rather than erroring if the server is paused at the
right(wrong) time. I'm not convinced we've solved every possible case
of this, so we still may see the backup succeed even when it's
supposed to fail. The ultimate hammer is to add Client.Timeout, but
that's a very blunt instrument and I'm afraid it could cause a timeout
when really we just have a lot of data to download or something.

There may be a better way to say "only time out if you literally
haven't heard a peep from the server in this long", but I haven't been
able to figure it out yet.

I also fixed how the authclustertests are run as they weren't using
the PROJECT parameter correctly. Now they can run concurrently with
clustertests, and with other copies of authclustertests without having
conflicts.
2022-02-02 12:03:46 -06:00
pokeeffe-molecula
e88c30c6cb
Merge pull request #1899 from molecula/cicd-will-it-never-end
remove dependence on gitlab artifact api; add s3 dump
2022-02-01 16:04:54 -06:00
pokeeffe-molecula
ca2def7389 dump to s3 2022-02-01 14:51:06 -06:00
pokeeffe-molecula
1e4b3321ff remove reliance on gitlab token 2022-02-01 14:40:38 -06:00
pokeeffe-molecula
6db05d6150 don't use gitlab api to get binaries 2022-02-01 14:22:24 -06:00
tgruben
8816583cd3
Merge pull request #1898 from molecula/sup-138
[SUP-138] add timestamp formatting to type FieldRow used in GroupBy
2022-01-31 14:52:54 -06:00
Todd Gruben
d7c082b515 add timestamp formating to type FieldRow used in GroupBy 2022-01-31 12:32:05 -06:00
souhailanoor
3ece8139fc
Merge pull request #1896 from molecula/auth-bug
FB1151-Enable auth for endpoint
2022-01-28 15:28:54 -06:00
Souhaila Noor
bae9d16c4f updated the tests 2022-01-28 14:28:59 -06:00
Souhaila Noor
20871a8780 remove asserting for log path 2022-01-28 13:07:22 -06:00
Souhaila Noor
1a4acfe97d fix bug with query bug 2022-01-28 13:01:08 -06:00
souhailanoor
baf5e47d8f
Merge branch 'master' into auth-bug 2022-01-28 12:12:19 -06:00
Souhaila Noor
f58ebbe505 enable auth for endpoint 2022-01-28 12:10:22 -06:00
pokeeffe-molecula
083670d20e
Merge pull request #1895 from molecula/cicd-will-it-never-end
added retries to go tests
2022-01-27 17:14:59 -06:00
pokeeffe-molecula
586e4d7f5a Merge branch 'master' into cicd-will-it-never-end 2022-01-27 15:50:21 -06:00
pokeeffe-molecula
d7401babd4 add retries....so these fracking flaky ass tests don't screw up the pipeline constantly 2022-01-27 15:49:54 -06:00
pokeeffe-molecula
1774062f24
Merge pull request #1894 from molecula/cicd-will-it-never-end
allow clustertests to fail
2022-01-27 15:24:44 -06:00
pokeeffe-molecula
7ff9e82b1b
Merge branch 'master' into cicd-will-it-never-end 2022-01-27 14:52:51 -06:00
pokeeffe-molecula
fedcdab1c2 allow clustertests to fail 2022-01-27 14:49:46 -06:00
pokeeffe-molecula
a8fd5f99f2
Merge pull request #1890 from molecula/fb1151-auth-tooling
FB-1151 auth tooling
2022-01-27 13:04:13 -06:00
pokeeffe-molecula
95605a4e59
Merge pull request #1891 from molecula/cicd-will-it-never-end
build roaring-migrate
2022-01-27 12:16:58 -06:00
souhailanoor
1d26739c90
Merge branch 'master' into fb1151-auth-tooling 2022-01-27 12:07:22 -06:00
pokeeffe-molecula
47f87f24c3
Merge branch 'master' into cicd-will-it-never-end 2022-01-27 11:42:40 -06:00
pokeeffe-molecula
05864f38df
Merge pull request #1893 from molecula/docker-is-messed-up
fix broken dockerfile
2022-01-27 11:42:14 -06:00
pokeeffe-molecula
d16ada75af use -o instead of a subsequent mv command 2022-01-27 11:36:16 -06:00
reesporte
1db6009d70 fix broken dockerfile
i think its gonna work this time!!!
2022-01-27 10:55:20 -06:00
pokeeffe-molecula
dff061ca22 now do it for the other one 2022-01-27 10:18:21 -06:00
pokeeffe-molecula
5d7c2437e9 trying again 2022-01-27 10:00:22 -06:00
pokeeffe-molecula
0f5ce612e0 building roaring-migrate for linux_amd64 2022-01-27 09:39:34 -06:00
pokeeffe-molecula
b67b8aff6c Merge branch 'master' into cicd-will-it-never-end 2022-01-27 09:38:14 -06:00
Souhaila Noor
0e1cf5bbbd Enable authentication/authorization for featurebase tools
- Add auth-token for featurebase import, backup and restore
- Add auth-token to http request
- Create a cluster tests with auth enabled
- Add test for import with auth enabled
2022-01-26 17:30:26 -06:00
Matthew Jaffee
d7c3fa2a93
Merge pull request #1889 from molecula/1174-projectify-clustertests
add project support to clustertests to allow for concurrent runs
2022-01-25 08:15:26 -06:00
Matthew Jaffee
71da3fdcb2 add docker-compose project to clustertests in CI to allow concurreny 2022-01-25 07:54:48 -06:00
Matthew Jaffee
7fbcba5c4b add GCP back in 2022-01-25 07:54:48 -06:00
Matthew Jaffee
3477534930 add project support to clustertests to allow for concurrent runs
also remove gcp tag... shouldn't be needed any more as I think the AWS
runners are properly configured.
2022-01-25 07:54:48 -06:00
pokeeffe-molecula
e0e86ec1d3 put docker containers in the right place 2022-01-24 18:34:14 -06:00
pokeeffe-molecula
8e775b88b9
Merge pull request #1875 from molecula/cicd-will-it-never-end
Added docker build & rpm, deb packaging for linux arm64
2022-01-24 17:15:13 -06:00
reese
de11a1d903
Merge pull request #1888 from molecula/fb1146
fb1146 - fixes panic on POST /transaction on non-primary node
2022-01-24 17:11:49 -06:00
reesporte
365789b791 remove unnecessary port bindings 2022-01-24 16:29:12 -06:00
pokeeffe-molecula
d389aae9c3
Merge branch 'master' into cicd-will-it-never-end 2022-01-24 16:12:54 -06:00
reesporte
ec543ac094 Merge branch 'master' into fb1146 2022-01-24 15:25:00 -06:00
reesporte
276088c386 fix panic on POST /transaction on non-primary node
- if we're a non-primary node, redirect to the primary
- if non-primary nodes can create transactions now, then the client should not receive an ErrNotPrimaryNode
- streamline metrics logic
2022-01-24 15:24:21 -06:00
pokeeffe-molecula
1721dd0dcf remove comments 2022-01-24 15:11:02 -06:00