Garrison Davis
4d75eda557
Add back ability to make on-demand instances
...
Also addressed the couple TODOs I left behind in the terraform.
2022-11-18 12:12:09 -06:00
Garrison Davis
d028b6bc4b
Make tflint and terraform fmt changes
2022-11-18 12:12:09 -06:00
Garrison Davis
3bfb65eb58
Make spot instance selection dynamic
...
The idea behind this is to give AWS more information about what
instances we can let it actually instantitate, rather than have it be
one fixed instance type.
e.g., in this case, we are okay with any Graviton instance with at least
2 vCPU and 8 GiB memory.
The easist way to do that is to instead use a launch template, with
ec2_fleets or spot fleets.
I took out the part where we even support on-demand instances. This can
be readded later if it is necessary.
2022-11-18 12:12:09 -06:00
Seebs
011174b631
make perf_able run at all, make it debug a bit better
...
switch perf-able to using same node type we use for other spot instances,
because otherwise it never finds any available capacity.
we switch the perf-able script to use the standard get_value function
instead of direct jq calls.
we try to grab server logs if the restore fails in the hopes of finding
out why the restore very occasionally fails.
2022-10-14 09:49:19 -05:00
Bruce Baranowski
b7516eacc5
CICD: fix Cleanup_Build_Job inconsistent failures ( #2098 )
...
* add aws profile to cleanup job
* Split cleanup into bash script
* change spot instances to one-tme
2022-06-14 11:49:25 -04:00
Bruce Baranowski
aa8057e9e4
CICD - Spot instances ( #2087 )
...
* spot instance test
* update outputs.tf to provide spot instances
* uptate outputs.tf data_node_ips
* propogate spot instance request tags to the instances
2022-05-31 17:25:09 -04:00
souhailanoor
ffed9531fc
FB-1253: Fixes for scheduled test ( #2048 )
...
* fix for changes in utilCluster
* fixes for samsung and backup-restore gauntlets
2022-05-06 12:00:04 -05:00
souhailanoor
b82375bca2
Tremor delete test scripts ( #1974 )
...
- terraform scripts to set up cluster
- cloud-formation scripts to set up cluster
- set up ingest node with kafka server and datagen
- set up second ingest node with molecula-consumer-kafka-static
- set up datadog in all nodes (ingest + featurebase)
- set up script to execute different queries
- only run delete test on schedule
2022-05-05 10:25:35 -05:00
reesporte
03df1ba6ad
remove trailing spaces en masse ( #2024 )
2022-04-18 09:31:35 -05:00
reesporte
f224e64bc3
setup auth cluster infra
...
also add test for sup218
Co-authored-by: rachithrr <rachith.ramaswamy@molecula.com>
Co-authored-by: bruce-b-molecula <bruce.baranowski@molecula.com>
2022-04-14 09:37:52 -05:00
reesporte
c61d565b3c
integration test for backup restore sev 2!
...
Co-authored-by: tgruben <tgruben@gmail.com>
2022-04-05 14:59:50 -05:00
reesporte
c9c36f5fc6
WIP: start integration test setup
...
TODO:
- remove commented out gitlab jobs
- make it run only on merge to master
2022-03-15 14:43:06 -05:00
pokeeffe-molecula
4fef282416
removed tfstate.backup files
2022-02-24 10:24:27 -06:00
pokeeffe-molecula
e2b1986504
make it so the autoscaler does not kill us...precious
2022-02-23 10:54:12 -06:00
pokeeffe-molecula
fba0f67bfa
added policy to read write S3
2022-02-22 15:23:39 -06:00
pokeeffe-molecula
9bc7839dcb
moved some stuff around; got test to execute
2022-02-21 08:31:46 -06:00
pokeeffe-molecula
f97878edcf
fixed arch problem
2022-02-14 16:31:55 -06:00
pokeeffe-molecula
92d491682d
added perf test
2022-02-11 15:38:33 -06:00
pokeeffe-molecula
bb1f403974
fixes to able defn
2022-02-10 13:56:59 -06:00
pokeeffe-molecula
3a0777c063
added 'able' perf testing environment
2022-02-08 16:30:35 -06:00
pokeeffe-molecula
1e4b3321ff
remove reliance on gitlab token
2022-02-01 14:40:38 -06:00
pokeeffe-molecula
bc89ca3553
now with real private_subnets!
2022-01-21 20:31:16 -06:00
pokeeffe-molecula
ff16924a0a
fixed path typo
2022-01-13 13:31:41 -06:00
pokeeffe-molecula
da3cabe642
Merge branch 'master' into cicd-smoketest
2022-01-13 12:57:42 -06:00
pokeeffe-molecula
04a2df3036
added basic integration tests
2022-01-13 12:57:26 -06:00
bruce-b-molecula
ef5736c73e
added tags to sg terraform
2022-01-12 18:59:28 -05:00
pokeeffe-molecula
394a6e9854
switching gauntlet to scheduled
2022-01-11 08:47:02 -06:00
pokeeffe-molecula
5ec9d7cf96
Now with more gauntlet
2022-01-10 16:11:03 -06:00
pokeeffe-molecula
63bf6dee2e
fix yaml
2022-01-10 10:38:11 -06:00
pokeeffe-molecula
d4e9852b09
try to get gauntlet to run e2e on GitLab
2022-01-10 10:28:51 -06:00
pokeeffe-molecula
286953c5fc
getting gauntlet working
2022-01-09 11:53:14 -06:00
pokeeffe-molecula
a5c36d5c21
remove un-needed files
2022-01-08 16:00:46 -06:00
pokeeffe-molecula
4743624210
refactored scripts for imperative setup and execution
2022-01-08 15:35:57 -06:00
pokeeffe-molecula
bb434639ad
cleaning up terraform to put in pre-prepared VPC
2022-01-07 17:25:48 -06:00
pokeeffe-molecula
b864d6b6f1
un-broke some stuff
2022-01-07 13:40:35 -06:00
Fletcher Haynes
369c91daf9
Fixed a few more things
2022-01-07 07:04:01 -08:00
Fletcher Haynes
d328ead713
Resolved conflicts
2022-01-07 06:59:08 -08:00
Fletcher Haynes
70833218b1
Added in auto-peering of smoketest VPC
2022-01-07 06:58:02 -08:00
pokeeffe-molecula
574be963ec
follow up changes to get vpn working - still no dice
2022-01-06 20:13:52 -06:00
Fletcher Haynes
56cf9f43f5
Added in connecting the gauntlet VPC to a VPC that can be reached via the VPN
2022-01-06 17:07:14 -08:00
pokeeffe-molecula
1fccfabc8f
changes based on feedback
2022-01-05 15:35:38 -06:00
pokeeffe-molecula
6959c424e3
getting smoke test report to show
2022-01-05 14:39:45 -06:00
pokeeffe-molecula
a2ee26b57c
running all of gauntlet in schedule
2022-01-05 12:25:41 -06:00
pokeeffe-molecula
f5b669508b
getting node deployed; first test
2022-01-04 20:55:23 -06:00
pokeeffe-molecula
2f68b2a6f6
set data nodes to 1; refine cluster test
2022-01-04 19:57:37 -06:00
pokeeffe-molecula
f51834be82
declare the cluster_prefix variable
2022-01-04 18:37:18 -06:00
pokeeffe-molecula
ca5633c594
add uniqueness to cluster prefix
2022-01-04 16:36:11 -06:00
pokeeffe-molecula
cfacc72c53
smoking or non-smoking?
2022-01-04 15:00:39 -06:00
pokeeffe-molecula
51ad67e06a
Update qa/tf/gauntlet/samsung/README.md
...
Co-authored-by: reese <45641995+reesporte@users.noreply.github.com>
2022-01-03 16:09:26 -06:00
pokeeffe-molecula
804b7b3146
Update qa/tf/README.md
...
Co-authored-by: reese <45641995+reesporte@users.noreply.github.com>
2022-01-03 16:06:54 -06:00
