Commit graph

8997 commits

Author SHA1 Message Date
Souhaila Noor
c2dfc35bdc added iam role 2021-11-08 13:21:07 -06:00
Souhaila Noor
aa4c7aa901 removed targets flag 2021-11-08 12:00:17 -06:00
Souhaila Noor
fe6bea04c2 fix var assignment 2021-11-08 11:55:17 -06:00
Souhaila Noor
32eb7ab097 access array value 2021-11-08 11:45:41 -06:00
Souhaila Noor
49fd477d95 updated var assignment 2021-11-08 11:39:17 -06:00
Souhaila Noor
6d4ae4c345 changed var assignment 2021-11-08 11:34:10 -06:00
Souhaila Noor
2b315c6634 removed instance id file 2021-11-08 11:23:05 -06:00
Souhaila Noor
26d77c51b5 removed variable overwrite 2021-11-08 11:06:55 -06:00
Souhaila Noor
8edfc0c9ff made instanceId a global variable 2021-11-08 11:00:49 -06:00
Souhaila Noor
4a42571dd9 fix for go 2021-11-08 10:45:10 -06:00
Souhaila Noor
22c0815288 fixed syntax error 2021-11-08 10:31:57 -06:00
Souhaila Noor
d3cc4d7f2a added argument to scp 2021-11-08 10:26:59 -06:00
Souhaila Noor
14265090db fixed arguments 2021-11-08 10:20:10 -06:00
Souhaila Noor
38a17e2b94 fixed typo 2021-11-08 09:40:14 -06:00
Souhaila Noor
1cdc8e4959 added aws image 2021-11-08 09:33:34 -06:00
Souhaila Noor
27e39b933f reverted change to aws configure 2021-11-08 09:21:14 -06:00
Souhaila Noor
ebde0142da add stage to configure featurebase 2021-11-08 09:14:47 -06:00
Souhaila Noor
e629e0165d install correct version of go 2021-11-08 08:42:49 -06:00
Souhaila Noor
aae5374248 fixed stages 2021-11-08 08:18:37 -06:00
Souhaila Noor
1befe2ad32 added aws config for terminate job 2021-11-08 08:10:20 -06:00
Souhaila Noor
4c2832ab31 fixed yaml syntax error 2021-11-08 07:59:15 -06:00
Souhaila Noor
79d1a005ce job to terminate ec2 instance 2021-11-08 07:55:42 -06:00
Souhaila Noor
5b5c003b1e private key fix 2021-11-08 07:43:31 -06:00
Souhaila Noor
df99dd7578 fixed typo 2021-11-07 09:31:34 -06:00
Souhaila Noor
76ba07e806 update ssh key filename 2021-11-07 09:29:46 -06:00
Souhaila Noor
46d6ced5b4 updated ssh permissions 2021-11-07 09:24:40 -06:00
Souhaila Noor
f0b2e6beea updated permissions for ssh key 2021-11-07 09:17:02 -06:00
Souhaila Noor
dfc98e3000 updated sleep time 2021-11-07 09:11:52 -06:00
Souhaila Noor
57d4eb45de gitlab path test2 2021-11-07 08:53:01 -06:00
Souhaila Noor
0e564a00e8 path for cloud-init 2021-11-07 08:47:10 -06:00
Souhaila Noor
606b718428 fixed path for cloud-init 2021-11-07 08:42:40 -06:00
Souhaila Noor
78713c6a8c test cloudinit 2021-11-07 08:39:43 -06:00
reesporte
66c7d59707 remove dot imports from catcher.go 2021-11-05 15:39:50 -05:00
Souhaila Noor
103312be8f added cloutinit 2021-11-05 15:04:09 -05:00
Matthew Jaffee
8d47efb666
Merge pull request #1753 from molecula/add-fgprof
add fgprof endpoint by default
2021-11-05 14:42:18 -05:00
Souhaila Noor
6531f90747 fixed syntax error 2021-11-05 14:26:20 -05:00
Souhaila Noor
bf93278ca3 scp binary 2021-11-05 14:24:02 -05:00
Souhaila Noor
179a0e7624 fixed typo for copy path 2021-11-05 14:03:14 -05:00
Matthew Jaffee
fd50c15243 add fgprof endpoint by default
to aid in debugging performance issues
2021-11-05 14:02:58 -05:00
Souhaila Noor
590e5edc57 reverted to last working version 2021-11-05 13:57:37 -05:00
Souhaila Noor
7a5ba0e5d6 Revert "sanity check for scp"
This reverts commit 86407ebcab.
2021-11-05 13:52:26 -05:00
Souhaila Noor
cf365db944 changed ssh config 2021-11-05 13:47:47 -05:00
Souhaila Noor
98e5f6deaf ssh key 2021-11-05 13:45:11 -05:00
Souhaila Noor
4b2322160b sanity 2021-11-05 13:41:13 -05:00
seebs
f02c5c0354
Merge pull request #1748 from molecula/core932
FB-932: rework Import to reduce copying and network traffic
2021-11-05 13:38:12 -05:00
Souhaila Noor
fae8d2d116 ssh add command 2021-11-05 13:32:15 -05:00
Souhaila Noor
642d4fcb86 fixed variable name 2021-11-05 13:27:03 -05:00
Seebs
c7e4bc0fd0 refactoring experiment
I'm not actually sold on this, but I'm not entirely unsold on it. It seems like
it does reduce the amount of duplication a lot, but also it's sort of a mess.

In the process, noticed that it makes more sense to grab the whole cluster
rather than just the nodes for an arbitrary shard for the shard==^0 case,
because then if we have an API (but no Qcx), we can be reasonably confident
that we'll be able to pick the local node for loopback even if we aren't
using the API directly.

Have thought about whether we should create our own Qcx in cases like that
but I really don't like the idea of automatically creating a Qcx.
2021-11-05 13:06:38 -05:00
Seebs
d4b06d077e Import/ImportValue API rework and improvements
Underlying goal: Don't use the http client to send messages back to the
local host. Also, when sending data to other nodes, don't collate it
from an ImportRequest into a completely different format, then immediately
collate that back into an ImportRequest. This does require changing
the logic over in ctl/import to make it create an ImportRequest.

Also, add additional testing to make sure we're actually trying anything
at all with several combinations (such as submitting import requests
which don't match the configuration of index or field), and improve
test coverage for that.

This introduces the ability to tell an http/client InternalClient about
a specific API that it should use for local queries where applicable.
That's not implemented outside of the import stuff, but should probably
be applied eventually to other things that are trying to talk to many
nodes one of which may be the local node. That behavior is contingent
on passing in a Qcx, because it is implicitly tied to an existing
execution context, and it can't assume that it can create a new one,
because that could deadlock.
2021-11-05 13:06:38 -05:00
Seebs
60ac6a929f make address lookup failures okay on MacOS 2021-11-05 13:06:38 -05:00