Alan Bernstein
31255b3269
Send results to S3
2017-01-11 09:25:37 -06:00
Alan Bernstein
3b00b3d8e5
Add output destination flag
2017-01-11 09:18:28 -06:00
Alan Bernstein
b1fa60a3bb
hardcode path
2017-01-11 08:40:40 -06:00
jaffee
1ed34ad439
Merge branch 'master' into benchmark-runner
2017-01-09 16:55:03 -06:00
jaffee
68d4194ec3
add overriding flags for bspawn config
2017-01-04 16:29:31 -06:00
jaffee
c3105f408b
remove redundant run-uuids in output
2017-01-04 11:49:56 -06:00
jaffee
1b797819b0
gather all output from bspawn into a single json obj
2017-01-04 11:43:26 -06:00
jaffee
8adfd259c6
change benchmark configs
2017-01-04 09:58:32 -06:00
jaffee
9c717e2eee
remove unused parallelBenchmark and move Serial
2017-01-04 09:11:53 -06:00
jaffee
75045471d2
rename agentNum arg to agent-num
2017-01-04 08:58:11 -06:00
jaffee
9a24b9b0e9
re-arrange bagent output
2017-01-03 16:54:02 -06:00
jaffee
6766c91cde
fix references to outdated "Agents" config
2017-01-03 16:36:27 -06:00
jaffee
025f4115b7
further refactor of building and copying pilosactl
2016-12-23 11:49:33 -06:00
jaffee
aa2db76247
factor copying binary to remote hosts into separate function
2016-12-22 15:03:18 -06:00
jaffee
01a5d8592f
build and copy pilosactl to remote agents
2016-12-22 12:19:18 -06:00
jaffee
f477d5f857
refactor/cleanup remote file creation
2016-12-22 09:23:55 -06:00
jaffee
2e0a195f50
make create's run_uuid consistent with bagent
2016-12-21 16:37:43 -06:00
alanbernstein
6b43894f7c
Merge pull request #221 from jaffee/204-run-uuid
...
add run-uuid to bspawn and thread through bagent and create
2016-12-21 14:33:58 -06:00
jaffee
99f234a1e2
add run-uuid to bspawn and thread through bagent and create
...
also add forgotten crypto/ssh dependency to vendor which adds an unfortunate
number of new files for all of golang.org/x/crypto
2016-12-20 14:03:24 -06:00
Ben Johnson
7a91cbdd6d
Add timestamps to import/sort.
...
The HTTP API, client, and `pilosactl` have been updated to allow
for a timestamp formatted using the pilosa date format of
`YYYY-MM-DDTHH:MM`.
2016-12-20 10:36:33 -07:00
Alan Bernstein
f0a2b0eca2
Remove extraneous whitespace in JSON output
2016-12-19 15:27:50 -06:00
Alan Bernstein
500a5db2e0
Update Bagent json tags
2016-12-19 15:27:15 -06:00
jaffee
d763b92de3
fix rebase issues
2016-12-19 15:12:56 -06:00
jaffee
a1d6187a2b
have bagent add metadata to results
...
need this to differentiate multiple agents' output when it's all going to stdout.
2016-12-19 15:10:35 -06:00
jaffee
c9f80e2b56
basic implementation of remote agent spawning
2016-12-19 15:09:16 -06:00
Matthew Jaffee
361a7b6d03
Merge pull request #199 from alanbernstein/benchmarks-readable
...
Use Duration's string representation in JSON output
2016-12-19 14:50:53 -06:00
Alan Bernstein
fad17ff9a1
Add -human flag to bagent
2016-12-19 14:49:09 -06:00
Matthew Jaffee
ffe9a89402
Merge pull request #200 from alanbernstein/benchmarks-zipf
...
Benchmarks zipf
2016-12-19 14:21:05 -06:00
jaffee
d649a48c21
creator can set GOMAXPROCS for remote pilosa nodes
2016-12-14 15:05:50 -06:00
jaffee
7b55adc39b
cleanup cluster shutdown and extra logging
2016-12-14 10:53:14 -06:00
jaffee
37d11b858e
clean up remote create, kill remote cluster
...
Had to jump through some hoops to kill the remote cluster reliably. Not all ssh
server implementations respect signals, so in order to kill the cluster, we
request a pty for the ssh session. This allows us to send the byte 0x03 which is
effectively the same has hitting Ctrl-c in an interactive ssh session. With a
pty, just closing the session also seems to kill the remote process.
2016-12-13 16:36:52 -06:00
Alan Bernstein
2becc6619d
Improve comment formatting and update usage
2016-12-13 13:25:31 -06:00
jaffee
bbb88e910f
create - start cluster over ssh when given hosts
2016-12-13 10:14:09 -06:00
jaffee
b97fb2b971
remove separate create() and get bspawn working again
2016-12-12 16:29:40 -06:00
Alan Bernstein
5c78164837
Add good defaults for zipf config
2016-12-12 16:11:23 -06:00
jaffee
e78fa1bc74
json output and local cluster log handling
2016-12-12 11:32:56 -06:00
Alan Bernstein
d58d1406f5
Add zipf benchmark with efficient random ID permutations
2016-12-08 19:14:24 -06:00
Alan Bernstein
76786e7ba0
Use Duration's string representation in JSON output
2016-12-08 15:06:02 -06:00
jaffee
33cbdba642
thread context through Benchmarks
...
Also fix a few ignored errors, an issue with pilosactl usage string, a broken
test, and a mistaken import.
2016-12-08 11:02:14 -06:00
jaffee
f9362c767d
make results nicer
2016-12-07 12:09:18 -06:00
jaffee
64b86f29cd
add slice height benchmark
2016-12-06 17:20:38 -06:00
jaffee
e5b54e7f4a
import benchmark sort by profile id after bitmap id
2016-12-06 16:11:00 -06:00
jaffee
aed735b85b
wire up import benchmark, fix bug with ImportCommand.Host
...
also add some config metadata to results in order to distinguish them
2016-12-06 10:16:28 -06:00
jaffee
4f9141b792
add import benchmark
2016-12-05 17:37:33 -06:00
Travis
dd6f41f551
standardizes on MaxSlice (instead of SliceN)
...
creates DB locally even if node doesn't have data for that DB
2016-11-30 12:59:17 -06:00
Travis
78666d6bba
Merge branch 'master' into db-specific-slices
2016-11-29 11:59:41 -06:00
jaffee
0588e0398c
rename imports umbel->pilosa
2016-11-28 15:45:18 -07:00
jaffee
e1e3222203
better documentation for bagent and bspawn
2016-11-28 15:45:18 -07:00
jaffee
8b23da6212
rename bench commands and args
...
lower case and dash separated
2016-11-28 15:45:18 -07:00
jaffee
c8b0fecd4a
add random query benchmark
2016-11-28 15:45:18 -07:00