Commit graph

104 commits

Author SHA1 Message Date
jaffee
aa5fc13e0b Merge branch 'master' into benchmark-runner 2017-01-09 16:55:03 -06:00
jaffee
5067b7492f add overriding flags for bspawn config 2017-01-04 16:29:31 -06:00
jaffee
8325db95d6 remove redundant run-uuids in output 2017-01-04 11:49:56 -06:00
jaffee
32d7bf0503 gather all output from bspawn into a single json obj 2017-01-04 11:43:26 -06:00
jaffee
e8af9f9051 change benchmark configs 2017-01-04 09:58:32 -06:00
jaffee
e3212b417e remove unused parallelBenchmark and move Serial 2017-01-04 09:11:53 -06:00
jaffee
e6b89bfa6e rename agentNum arg to agent-num 2017-01-04 08:58:11 -06:00
jaffee
a0aad147e0 re-arrange bagent output 2017-01-03 16:54:02 -06:00
jaffee
7128385f08 fix references to outdated "Agents" config 2017-01-03 16:36:27 -06:00
jaffee
a126df414c further refactor of building and copying pilosactl 2016-12-23 11:49:33 -06:00
jaffee
9ffbe241e8 factor copying binary to remote hosts into separate function 2016-12-22 15:03:18 -06:00
jaffee
537b3878ef build and copy pilosactl to remote agents 2016-12-22 12:19:18 -06:00
jaffee
73c0ea2f0c refactor/cleanup remote file creation 2016-12-22 09:23:55 -06:00
jaffee
bc9fbe450d make create's run_uuid consistent with bagent 2016-12-21 16:37:43 -06:00
alanbernstein
77cd51b9c5 Merge pull request #221 from jaffee/204-run-uuid
add run-uuid to bspawn and thread through bagent and create
2016-12-21 14:33:58 -06:00
jaffee
d506927700 add run-uuid to bspawn and thread through bagent and create
also add forgotten crypto/ssh dependency to vendor which adds an unfortunate
number of new files for all of golang.org/x/crypto
2016-12-20 14:03:24 -06:00
Ben Johnson
7467608234
Add timestamps to import/sort.
The HTTP API, client, and `pilosactl` have been updated to allow
for a timestamp formatted using the pilosa date format of
`YYYY-MM-DDTHH:MM`.
2016-12-20 10:36:33 -07:00
Alan Bernstein
b1795eb04e Remove extraneous whitespace in JSON output 2016-12-19 15:27:50 -06:00
Alan Bernstein
e7a605e4fe Update Bagent json tags 2016-12-19 15:27:15 -06:00
jaffee
a03ecf92e9 fix rebase issues 2016-12-19 15:12:56 -06:00
jaffee
293621516e have bagent add metadata to results
need this to differentiate multiple agents' output when it's all going to stdout.
2016-12-19 15:10:35 -06:00
jaffee
d196c39bce basic implementation of remote agent spawning 2016-12-19 15:09:16 -06:00
Matthew Jaffee
e211dbd54a Merge pull request #199 from alanbernstein/benchmarks-readable
Use Duration's string representation in JSON output
2016-12-19 14:50:53 -06:00
Alan Bernstein
8690157d3f Add -human flag to bagent 2016-12-19 14:49:09 -06:00
Matthew Jaffee
58f697d814 Merge pull request #200 from alanbernstein/benchmarks-zipf
Benchmarks zipf
2016-12-19 14:21:05 -06:00
jaffee
0c6e6e4f44 creator can set GOMAXPROCS for remote pilosa nodes 2016-12-14 15:05:50 -06:00
jaffee
9d5acdeecd cleanup cluster shutdown and extra logging 2016-12-14 10:53:14 -06:00
jaffee
968e82d1ad clean up remote create, kill remote cluster
Had to jump through some hoops to kill the remote cluster reliably. Not all ssh
server implementations respect signals, so in order to kill the cluster, we
request a pty for the ssh session. This allows us to send the byte 0x03 which is
effectively the same has hitting Ctrl-c in an interactive ssh session. With a
pty, just closing the session also seems to kill the remote process.
2016-12-13 16:36:52 -06:00
Alan Bernstein
2968c15a37 Improve comment formatting and update usage 2016-12-13 13:25:31 -06:00
jaffee
6829f7cdd0 create - start cluster over ssh when given hosts 2016-12-13 10:14:09 -06:00
jaffee
e72e82ca7f remove separate create() and get bspawn working again 2016-12-12 16:29:40 -06:00
Alan Bernstein
587d4259a1 Add good defaults for zipf config 2016-12-12 16:11:23 -06:00
jaffee
bd78a7c1b9 json output and local cluster log handling 2016-12-12 11:32:56 -06:00
Alan Bernstein
4de72e27dd Add zipf benchmark with efficient random ID permutations 2016-12-08 19:14:24 -06:00
Alan Bernstein
7dfb53d08e Use Duration's string representation in JSON output 2016-12-08 15:06:02 -06:00
jaffee
53171da640 thread context through Benchmarks
Also fix a few ignored errors, an issue with pilosactl usage string, a broken
test, and a mistaken import.
2016-12-08 11:02:14 -06:00
jaffee
4c67cb30c0 make results nicer 2016-12-07 12:09:18 -06:00
jaffee
b4bb9cf70d add slice height benchmark 2016-12-06 17:20:38 -06:00
jaffee
af1d35affc import benchmark sort by profile id after bitmap id 2016-12-06 16:11:00 -06:00
jaffee
838941b26a wire up import benchmark, fix bug with ImportCommand.Host
also add some config metadata to results in order to distinguish them
2016-12-06 10:16:28 -06:00
jaffee
e5edf3e432 add import benchmark 2016-12-05 17:37:33 -06:00
Travis
05f65ef09c standardizes on MaxSlice (instead of SliceN)
creates DB locally even if node doesn't have data for that DB
2016-11-30 12:59:17 -06:00
Travis
4d1c12b4d7 Merge branch 'master' into db-specific-slices 2016-11-29 11:59:41 -06:00
jaffee
1d0a314287 rename imports umbel->pilosa 2016-11-28 15:45:18 -07:00
jaffee
86e226d574 better documentation for bagent and bspawn 2016-11-28 15:45:18 -07:00
jaffee
a3b69f9066 rename bench commands and args
lower case and dash separated
2016-11-28 15:45:18 -07:00
jaffee
aa2b4949d8 add random query benchmark 2016-11-28 15:45:18 -07:00
jaffee
df6e519222 bspawn can create and tear down cluster for benchmarks 2016-11-28 15:45:18 -07:00
jaffee
65ac486b4c refactor Init and provide ClientType option
Benchmark implementations can now use 'HasClient' as a component which provides
an Init method which sets up the pilosa client in a configurable way.
Implementations must still expose the ClientType argument through ConsumeFlags
and describe it in Usage()
2016-11-28 15:45:17 -07:00
jaffee
2f4171bba8 add agentNum to benchmark Init as well as run 2016-11-28 15:45:17 -07:00