Commit graph

118 commits

Author SHA1 Message Date
jaffee
825ce4ca89 dont' include stdin/out/err in create output 2017-01-13 14:51:45 -06:00
jaffee
6cdb8c2ed8 remove 'type' flag from creator
type is implied by whether or not 'hosts' is set
2017-01-13 14:26:24 -06:00
jaffee
db302b3419 improve output, docs, default behavior for create cmd 2017-01-13 13:46:11 -06:00
jaffee
34e056c9c6 fix up bspawn Usage, and field naming 2017-01-12 15:45:02 -06:00
jaffee
2a50ed9c6d rename ssh stuff for consistency and less stuttering 2017-01-12 14:32:50 -06:00
jaffee
7594e65667 options to build and copy pilosa binary for cluster creation
also some refactoring
2017-01-12 14:32:50 -06:00
Alan Bernstein
53c15af4c4 Remove absolute path to pilosactl 2017-01-11 13:46:32 -06:00
Alan Bernstein
a05b772373 Remove -output flag from bagent 2017-01-11 13:12:19 -06:00
Alan Bernstein
7f25abeb2e Switch default from s3 to stdout 2017-01-11 13:11:55 -06:00
Alan Bernstein
bfd405a8ff Update NewS3Uploader call 2017-01-11 13:10:52 -06:00
Alan Bernstein
d1e9ae2924 Rename 'aws' destination to 's3' 2017-01-11 10:41:25 -06:00
Alan Bernstein
c1ca299904 Send results to S3 2017-01-11 09:25:37 -06:00
Alan Bernstein
bb1157394d Add output destination flag 2017-01-11 09:18:28 -06:00
Alan Bernstein
38933e742b hardcode path 2017-01-11 08:40:40 -06:00
jaffee
aa5fc13e0b Merge branch 'master' into benchmark-runner 2017-01-09 16:55:03 -06:00
jaffee
5067b7492f add overriding flags for bspawn config 2017-01-04 16:29:31 -06:00
jaffee
8325db95d6 remove redundant run-uuids in output 2017-01-04 11:49:56 -06:00
jaffee
32d7bf0503 gather all output from bspawn into a single json obj 2017-01-04 11:43:26 -06:00
jaffee
e8af9f9051 change benchmark configs 2017-01-04 09:58:32 -06:00
jaffee
e3212b417e remove unused parallelBenchmark and move Serial 2017-01-04 09:11:53 -06:00
jaffee
e6b89bfa6e rename agentNum arg to agent-num 2017-01-04 08:58:11 -06:00
jaffee
a0aad147e0 re-arrange bagent output 2017-01-03 16:54:02 -06:00
jaffee
7128385f08 fix references to outdated "Agents" config 2017-01-03 16:36:27 -06:00
jaffee
a126df414c further refactor of building and copying pilosactl 2016-12-23 11:49:33 -06:00
jaffee
9ffbe241e8 factor copying binary to remote hosts into separate function 2016-12-22 15:03:18 -06:00
jaffee
537b3878ef build and copy pilosactl to remote agents 2016-12-22 12:19:18 -06:00
jaffee
73c0ea2f0c refactor/cleanup remote file creation 2016-12-22 09:23:55 -06:00
jaffee
bc9fbe450d make create's run_uuid consistent with bagent 2016-12-21 16:37:43 -06:00
alanbernstein
77cd51b9c5 Merge pull request #221 from jaffee/204-run-uuid
add run-uuid to bspawn and thread through bagent and create
2016-12-21 14:33:58 -06:00
jaffee
d506927700 add run-uuid to bspawn and thread through bagent and create
also add forgotten crypto/ssh dependency to vendor which adds an unfortunate
number of new files for all of golang.org/x/crypto
2016-12-20 14:03:24 -06:00
Ben Johnson
7467608234
Add timestamps to import/sort.
The HTTP API, client, and `pilosactl` have been updated to allow
for a timestamp formatted using the pilosa date format of
`YYYY-MM-DDTHH:MM`.
2016-12-20 10:36:33 -07:00
Alan Bernstein
b1795eb04e Remove extraneous whitespace in JSON output 2016-12-19 15:27:50 -06:00
Alan Bernstein
e7a605e4fe Update Bagent json tags 2016-12-19 15:27:15 -06:00
jaffee
a03ecf92e9 fix rebase issues 2016-12-19 15:12:56 -06:00
jaffee
293621516e have bagent add metadata to results
need this to differentiate multiple agents' output when it's all going to stdout.
2016-12-19 15:10:35 -06:00
jaffee
d196c39bce basic implementation of remote agent spawning 2016-12-19 15:09:16 -06:00
Matthew Jaffee
e211dbd54a Merge pull request #199 from alanbernstein/benchmarks-readable
Use Duration's string representation in JSON output
2016-12-19 14:50:53 -06:00
Alan Bernstein
8690157d3f Add -human flag to bagent 2016-12-19 14:49:09 -06:00
Matthew Jaffee
58f697d814 Merge pull request #200 from alanbernstein/benchmarks-zipf
Benchmarks zipf
2016-12-19 14:21:05 -06:00
jaffee
0c6e6e4f44 creator can set GOMAXPROCS for remote pilosa nodes 2016-12-14 15:05:50 -06:00
jaffee
9d5acdeecd cleanup cluster shutdown and extra logging 2016-12-14 10:53:14 -06:00
jaffee
968e82d1ad clean up remote create, kill remote cluster
Had to jump through some hoops to kill the remote cluster reliably. Not all ssh
server implementations respect signals, so in order to kill the cluster, we
request a pty for the ssh session. This allows us to send the byte 0x03 which is
effectively the same has hitting Ctrl-c in an interactive ssh session. With a
pty, just closing the session also seems to kill the remote process.
2016-12-13 16:36:52 -06:00
Alan Bernstein
2968c15a37 Improve comment formatting and update usage 2016-12-13 13:25:31 -06:00
jaffee
6829f7cdd0 create - start cluster over ssh when given hosts 2016-12-13 10:14:09 -06:00
jaffee
e72e82ca7f remove separate create() and get bspawn working again 2016-12-12 16:29:40 -06:00
Alan Bernstein
587d4259a1 Add good defaults for zipf config 2016-12-12 16:11:23 -06:00
jaffee
bd78a7c1b9 json output and local cluster log handling 2016-12-12 11:32:56 -06:00
Alan Bernstein
4de72e27dd Add zipf benchmark with efficient random ID permutations 2016-12-08 19:14:24 -06:00
Alan Bernstein
7dfb53d08e Use Duration's string representation in JSON output 2016-12-08 15:06:02 -06:00
jaffee
53171da640 thread context through Benchmarks
Also fix a few ignored errors, an issue with pilosactl usage string, a broken
test, and a mistaken import.
2016-12-08 11:02:14 -06:00