Commit graph

125 commits

Author SHA1 Message Date
jaffee
0c4cae30fc remove agentNum from Benchmark.Run
Benchmarks should modify their parameters in Init based on the agentNum
2017-01-18 20:57:14 -06:00
jaffee
d996e9d0b6 make bspawn config files consistent and minimal 2017-01-16 12:22:53 -06:00
jaffee
e92158dea6 show spawn config in output instead of just agents 2017-01-16 12:18:49 -06:00
jaffee
06cf5e2223 default -human to true. show defaults in Usage() 2017-01-16 12:05:58 -06:00
jaffee
b3ae286a10 bspawn tweaks and bugfix
fix grammar in comment
always use creator args if pilosaHosts isn't set
use creator's FinalHosts rather than Hosts
2017-01-13 20:50:33 -06:00
jaffee
75925db611 make pilosactl Usage(s) more consistent 2017-01-13 15:15:52 -06:00
jaffee
7533ca4ab1 don't connect to hosts twice when creating remote cluster 2017-01-13 14:52:42 -06:00
jaffee
a02b8a5854 dont' include stdin/out/err in create output 2017-01-13 14:51:45 -06:00
jaffee
09be21799b remove 'type' flag from creator
type is implied by whether or not 'hosts' is set
2017-01-13 14:26:24 -06:00
jaffee
47b362925a improve output, docs, default behavior for create cmd 2017-01-13 13:46:11 -06:00
jaffee
ae6293c347 fix up bspawn Usage, and field naming 2017-01-12 15:45:02 -06:00
jaffee
c6aa941521 rename ssh stuff for consistency and less stuttering 2017-01-12 14:32:50 -06:00
jaffee
58e173ba57 options to build and copy pilosa binary for cluster creation
also some refactoring
2017-01-12 14:32:50 -06:00
Alan Bernstein
289093de7f Remove absolute path to pilosactl 2017-01-11 13:46:32 -06:00
Alan Bernstein
a680fc7b1a Remove -output flag from bagent 2017-01-11 13:12:19 -06:00
Alan Bernstein
9ab38c488f Switch default from s3 to stdout 2017-01-11 13:11:55 -06:00
Alan Bernstein
ebb8c6ce22 Update NewS3Uploader call 2017-01-11 13:10:52 -06:00
Alan Bernstein
084579895a Rename 'aws' destination to 's3' 2017-01-11 10:41:25 -06:00
Alan Bernstein
31255b3269 Send results to S3 2017-01-11 09:25:37 -06:00
Alan Bernstein
3b00b3d8e5 Add output destination flag 2017-01-11 09:18:28 -06:00
Alan Bernstein
b1fa60a3bb hardcode path 2017-01-11 08:40:40 -06:00
jaffee
1ed34ad439 Merge branch 'master' into benchmark-runner 2017-01-09 16:55:03 -06:00
jaffee
68d4194ec3 add overriding flags for bspawn config 2017-01-04 16:29:31 -06:00
jaffee
c3105f408b remove redundant run-uuids in output 2017-01-04 11:49:56 -06:00
jaffee
1b797819b0 gather all output from bspawn into a single json obj 2017-01-04 11:43:26 -06:00
jaffee
8adfd259c6 change benchmark configs 2017-01-04 09:58:32 -06:00
jaffee
9c717e2eee remove unused parallelBenchmark and move Serial 2017-01-04 09:11:53 -06:00
jaffee
75045471d2 rename agentNum arg to agent-num 2017-01-04 08:58:11 -06:00
jaffee
9a24b9b0e9 re-arrange bagent output 2017-01-03 16:54:02 -06:00
jaffee
6766c91cde fix references to outdated "Agents" config 2017-01-03 16:36:27 -06:00
jaffee
025f4115b7 further refactor of building and copying pilosactl 2016-12-23 11:49:33 -06:00
jaffee
aa2db76247 factor copying binary to remote hosts into separate function 2016-12-22 15:03:18 -06:00
jaffee
01a5d8592f build and copy pilosactl to remote agents 2016-12-22 12:19:18 -06:00
jaffee
f477d5f857 refactor/cleanup remote file creation 2016-12-22 09:23:55 -06:00
jaffee
2e0a195f50 make create's run_uuid consistent with bagent 2016-12-21 16:37:43 -06:00
alanbernstein
6b43894f7c Merge pull request #221 from jaffee/204-run-uuid
add run-uuid to bspawn and thread through bagent and create
2016-12-21 14:33:58 -06:00
jaffee
99f234a1e2 add run-uuid to bspawn and thread through bagent and create
also add forgotten crypto/ssh dependency to vendor which adds an unfortunate
number of new files for all of golang.org/x/crypto
2016-12-20 14:03:24 -06:00
Ben Johnson
7a91cbdd6d Add timestamps to import/sort.
The HTTP API, client, and `pilosactl` have been updated to allow
for a timestamp formatted using the pilosa date format of
`YYYY-MM-DDTHH:MM`.
2016-12-20 10:36:33 -07:00
Alan Bernstein
f0a2b0eca2 Remove extraneous whitespace in JSON output 2016-12-19 15:27:50 -06:00
Alan Bernstein
500a5db2e0 Update Bagent json tags 2016-12-19 15:27:15 -06:00
jaffee
d763b92de3 fix rebase issues 2016-12-19 15:12:56 -06:00
jaffee
a1d6187a2b have bagent add metadata to results
need this to differentiate multiple agents' output when it's all going to stdout.
2016-12-19 15:10:35 -06:00
jaffee
c9f80e2b56 basic implementation of remote agent spawning 2016-12-19 15:09:16 -06:00
Matthew Jaffee
361a7b6d03 Merge pull request #199 from alanbernstein/benchmarks-readable
Use Duration's string representation in JSON output
2016-12-19 14:50:53 -06:00
Alan Bernstein
fad17ff9a1 Add -human flag to bagent 2016-12-19 14:49:09 -06:00
Matthew Jaffee
ffe9a89402 Merge pull request #200 from alanbernstein/benchmarks-zipf
Benchmarks zipf
2016-12-19 14:21:05 -06:00
jaffee
d649a48c21 creator can set GOMAXPROCS for remote pilosa nodes 2016-12-14 15:05:50 -06:00
jaffee
7b55adc39b cleanup cluster shutdown and extra logging 2016-12-14 10:53:14 -06:00
jaffee
37d11b858e clean up remote create, kill remote cluster
Had to jump through some hoops to kill the remote cluster reliably. Not all ssh
server implementations respect signals, so in order to kill the cluster, we
request a pty for the ssh session. This allows us to send the byte 0x03 which is
effectively the same has hitting Ctrl-c in an interactive ssh session. With a
pty, just closing the session also seems to kill the remote process.
2016-12-13 16:36:52 -06:00
Alan Bernstein
2becc6619d Improve comment formatting and update usage 2016-12-13 13:25:31 -06:00