Commit graph

357 commits

Author SHA1 Message Date
Alan Bernstein
31255b3269 Send results to S3 2017-01-11 09:25:37 -06:00
Alan Bernstein
3b00b3d8e5 Add output destination flag 2017-01-11 09:18:28 -06:00
Alan Bernstein
b1fa60a3bb hardcode path 2017-01-11 08:40:40 -06:00
jaffee
1ed34ad439 Merge branch 'master' into benchmark-runner 2017-01-09 16:55:03 -06:00
jaffee
68d4194ec3 add overriding flags for bspawn config 2017-01-04 16:29:31 -06:00
jaffee
c3105f408b remove redundant run-uuids in output 2017-01-04 11:49:56 -06:00
jaffee
1b797819b0 gather all output from bspawn into a single json obj 2017-01-04 11:43:26 -06:00
jaffee
8adfd259c6 change benchmark configs 2017-01-04 09:58:32 -06:00
jaffee
9c717e2eee remove unused parallelBenchmark and move Serial 2017-01-04 09:11:53 -06:00
jaffee
75045471d2 rename agentNum arg to agent-num 2017-01-04 08:58:11 -06:00
jaffee
9a24b9b0e9 re-arrange bagent output 2017-01-03 16:54:02 -06:00
jaffee
6766c91cde fix references to outdated "Agents" config 2017-01-03 16:36:27 -06:00
jaffee
025f4115b7 further refactor of building and copying pilosactl 2016-12-23 11:49:33 -06:00
jaffee
aa2db76247 factor copying binary to remote hosts into separate function 2016-12-22 15:03:18 -06:00
jaffee
01a5d8592f build and copy pilosactl to remote agents 2016-12-22 12:19:18 -06:00
jaffee
f477d5f857 refactor/cleanup remote file creation 2016-12-22 09:23:55 -06:00
jaffee
2e0a195f50 make create's run_uuid consistent with bagent 2016-12-21 16:37:43 -06:00
alanbernstein
6b43894f7c Merge pull request #221 from jaffee/204-run-uuid
add run-uuid to bspawn and thread through bagent and create
2016-12-21 14:33:58 -06:00
jaffee
99f234a1e2 add run-uuid to bspawn and thread through bagent and create
also add forgotten crypto/ssh dependency to vendor which adds an unfortunate
number of new files for all of golang.org/x/crypto
2016-12-20 14:03:24 -06:00
Ben Johnson
7a91cbdd6d Add timestamps to import/sort.
The HTTP API, client, and `pilosactl` have been updated to allow
for a timestamp formatted using the pilosa date format of
`YYYY-MM-DDTHH:MM`.
2016-12-20 10:36:33 -07:00
Alan Bernstein
f0a2b0eca2 Remove extraneous whitespace in JSON output 2016-12-19 15:27:50 -06:00
Alan Bernstein
500a5db2e0 Update Bagent json tags 2016-12-19 15:27:15 -06:00
jaffee
d763b92de3 fix rebase issues 2016-12-19 15:12:56 -06:00
jaffee
a1d6187a2b have bagent add metadata to results
need this to differentiate multiple agents' output when it's all going to stdout.
2016-12-19 15:10:35 -06:00
jaffee
c9f80e2b56 basic implementation of remote agent spawning 2016-12-19 15:09:16 -06:00
Matthew Jaffee
361a7b6d03 Merge pull request #199 from alanbernstein/benchmarks-readable
Use Duration's string representation in JSON output
2016-12-19 14:50:53 -06:00
Alan Bernstein
fad17ff9a1 Add -human flag to bagent 2016-12-19 14:49:09 -06:00
Matthew Jaffee
ffe9a89402 Merge pull request #200 from alanbernstein/benchmarks-zipf
Benchmarks zipf
2016-12-19 14:21:05 -06:00
jaffee
d649a48c21 creator can set GOMAXPROCS for remote pilosa nodes 2016-12-14 15:05:50 -06:00
jaffee
7b55adc39b cleanup cluster shutdown and extra logging 2016-12-14 10:53:14 -06:00
jaffee
37d11b858e clean up remote create, kill remote cluster
Had to jump through some hoops to kill the remote cluster reliably. Not all ssh
server implementations respect signals, so in order to kill the cluster, we
request a pty for the ssh session. This allows us to send the byte 0x03 which is
effectively the same has hitting Ctrl-c in an interactive ssh session. With a
pty, just closing the session also seems to kill the remote process.
2016-12-13 16:36:52 -06:00
Alan Bernstein
2becc6619d Improve comment formatting and update usage 2016-12-13 13:25:31 -06:00
jaffee
bbb88e910f create - start cluster over ssh when given hosts 2016-12-13 10:14:09 -06:00
jaffee
b97fb2b971 remove separate create() and get bspawn working again 2016-12-12 16:29:40 -06:00
Alan Bernstein
5c78164837 Add good defaults for zipf config 2016-12-12 16:11:23 -06:00
jaffee
e78fa1bc74 json output and local cluster log handling 2016-12-12 11:32:56 -06:00
Alan Bernstein
d58d1406f5 Add zipf benchmark with efficient random ID permutations 2016-12-08 19:14:24 -06:00
Alan Bernstein
76786e7ba0 Use Duration's string representation in JSON output 2016-12-08 15:06:02 -06:00
jaffee
33cbdba642 thread context through Benchmarks
Also fix a few ignored errors, an issue with pilosactl usage string, a broken
test, and a mistaken import.
2016-12-08 11:02:14 -06:00
jaffee
f9362c767d make results nicer 2016-12-07 12:09:18 -06:00
jaffee
64b86f29cd add slice height benchmark 2016-12-06 17:20:38 -06:00
jaffee
e5b54e7f4a import benchmark sort by profile id after bitmap id 2016-12-06 16:11:00 -06:00
jaffee
aed735b85b wire up import benchmark, fix bug with ImportCommand.Host
also add some config metadata to results in order to distinguish them
2016-12-06 10:16:28 -06:00
jaffee
4f9141b792 add import benchmark 2016-12-05 17:37:33 -06:00
Travis
dd6f41f551 standardizes on MaxSlice (instead of SliceN)
creates DB locally even if node doesn't have data for that DB
2016-11-30 12:59:17 -06:00
Travis
78666d6bba Merge branch 'master' into db-specific-slices 2016-11-29 11:59:41 -06:00
jaffee
0588e0398c rename imports umbel->pilosa 2016-11-28 15:45:18 -07:00
jaffee
e1e3222203 better documentation for bagent and bspawn 2016-11-28 15:45:18 -07:00
jaffee
8b23da6212 rename bench commands and args
lower case and dash separated
2016-11-28 15:45:18 -07:00
jaffee
c8b0fecd4a add random query benchmark 2016-11-28 15:45:18 -07:00