Commit graph

776 commits

Author SHA1 Message Date
jaffee
d649a48c21 creator can set GOMAXPROCS for remote pilosa nodes 2016-12-14 15:05:50 -06:00
jaffee
7b55adc39b cleanup cluster shutdown and extra logging 2016-12-14 10:53:14 -06:00
jaffee
37d11b858e clean up remote create, kill remote cluster
Had to jump through some hoops to kill the remote cluster reliably. Not all ssh
server implementations respect signals, so in order to kill the cluster, we
request a pty for the ssh session. This allows us to send the byte 0x03 which is
effectively the same has hitting Ctrl-c in an interactive ssh session. With a
pty, just closing the session also seems to kill the remote process.
2016-12-13 16:36:52 -06:00
jaffee
bbb88e910f create - start cluster over ssh when given hosts 2016-12-13 10:14:09 -06:00
jaffee
b97fb2b971 remove separate create() and get bspawn working again 2016-12-12 16:29:40 -06:00
jaffee
e78fa1bc74 json output and local cluster log handling 2016-12-12 11:32:56 -06:00
Matthew Jaffee
493472d88f Merge pull request #196 from jaffee/195-fix-context
thread context through Benchmarks
2016-12-08 11:09:36 -06:00
jaffee
33cbdba642 thread context through Benchmarks
Also fix a few ignored errors, an issue with pilosactl usage string, a broken
test, and a mistaken import.
2016-12-08 11:02:14 -06:00
tgruben
e223759b65 Merge pull request #191 from jaffee/166-single-slice
166 single slice
2016-12-08 10:31:22 -06:00
Alan Bernstein
dad85b6eb3 Merge stats updates 2016-12-07 17:30:08 -06:00
alanbernstein
bc66081e5e Merge pull request #192 from jaffee/alan-enhanced-stats
Alan enhanced stats
2016-12-07 17:18:43 -06:00
Travis Turner
fed17fa788 Merge pull request #189 from jaffee/187-benchmark-docs
187 benchmark docs
2016-12-07 15:27:41 -06:00
Alan Bernstein
ff87661268 Move sqrt out of Add() 2016-12-07 12:45:14 -06:00
Alan Bernstein
fbae2f7fe9 Add standard deviation to stats 2016-12-07 12:44:52 -06:00
jaffee
f9362c767d make results nicer 2016-12-07 12:09:18 -06:00
tgruben
492df23bde Merge pull request #186 from jaffee/170-import-benchmark
170 import benchmark
2016-12-07 10:47:46 -06:00
jaffee
64b86f29cd add slice height benchmark 2016-12-06 17:20:38 -06:00
jaffee
e5b54e7f4a import benchmark sort by profile id after bitmap id 2016-12-06 16:11:00 -06:00
jaffee
4132f0b049 clean up benchmark docs a bit 2016-12-06 11:00:59 -06:00
jaffee
b05dd5c4e3 first cut at benchmark readme 2016-12-06 10:49:00 -06:00
jaffee
aed735b85b wire up import benchmark, fix bug with ImportCommand.Host
also add some config metadata to results in order to distinguish them
2016-12-06 10:16:28 -06:00
jaffee
4f9141b792 add import benchmark 2016-12-05 17:37:33 -06:00
jaffee
15eea18d9b add option to save all stats 2016-12-01 15:46:41 -07:00
Matthew Jaffee
c31e6d6345 Merge pull request #2 from codysoyland/benchmark-runner
Add missing dependency golang.org/x/sync/errgroup
2016-11-29 15:23:07 -07:00
Cody Soyland
fbf85a07d6 Merge branch 'master' into benchmark-runner 2016-11-29 16:10:56 -06:00
Matthew Jaffee
89fb6c123a Merge pull request #147 from codysoyland/145-remove-godep
Remove Godep now that we use Glide
2016-11-29 15:06:30 -07:00
Cody Soyland
de398a1af8 Modify docs for people scared of piping to bash ;) 2016-11-29 16:04:19 -06:00
Cody Soyland
e5be2eddeb Remove Godep now that we use Glide 2016-11-29 15:15:11 -06:00
Matthew Jaffee
ee7240107c Merge pull request #146 from codysoyland/145-package-manager
Switch to Glide.sh for dependency management (Fixes #145)
2016-11-29 14:06:58 -07:00
Cody Soyland
27f49c2479 Add missing dependency golang.org/x/sync/errgroup 2016-11-29 13:37:27 -06:00
Cody Soyland
768c9bd3d3 Switch to Glide.sh for dependency management (Fixes #145) 2016-11-29 13:35:23 -06:00
Cody Soyland
917cd86185 Switch to Glide.sh for dependency management (Fixes #145) 2016-11-29 12:36:58 -06:00
jaffee
0588e0398c rename imports umbel->pilosa 2016-11-28 15:45:18 -07:00
jaffee
e1e3222203 better documentation for bagent and bspawn 2016-11-28 15:45:18 -07:00
jaffee
8b23da6212 rename bench commands and args
lower case and dash separated
2016-11-28 15:45:18 -07:00
jaffee
66ac8575c2 rename QueryMaker -> QueryGenerator 2016-11-28 15:45:18 -07:00
jaffee
0b0ff542b1 fixup imports in multidb 2016-11-28 15:45:18 -07:00
jaffee
c41fc7e520 use errgroup to simplify parallel benchmark Init 2016-11-28 15:45:18 -07:00
jaffee
c8b0fecd4a add random query benchmark 2016-11-28 15:45:18 -07:00
jaffee
6beef90a82 add some benchmark helpers for randomly generating queries 2016-11-28 15:45:18 -07:00
jaffee
069484ab0e bspawn can create and tear down cluster for benchmarks 2016-11-28 15:45:18 -07:00
jaffee
d3714729ac add fine grained stats within benchmarks 2016-11-28 15:45:17 -07:00
jaffee
05a70d5fb2 refactor Init and provide ClientType option
Benchmark implementations can now use 'HasClient' as a component which provides
an Init method which sets up the pilosa client in a configurable way.
Implementations must still expose the ClientType argument through ConsumeFlags
and describe it in Usage()
2016-11-28 15:45:17 -07:00
jaffee
da024fb0d8 add agentNum to benchmark Init as well as run 2016-11-28 15:45:17 -07:00
jaffee
5cebe8e043 split benchmarks into separate files 2016-11-28 15:45:17 -07:00
jaffee
488ed1259c fix broken context stuff after rebase 2016-11-28 15:45:17 -07:00
jaffee
85b4e83c2d add MultiDBSetBits benchmark 2016-11-28 15:45:17 -07:00
jaffee
62a571e442 don't repeat benchmark docs in 3 places
make Usage() the single place where arguments are described.
2016-11-28 15:45:17 -07:00
jaffee
ce34faa9c9 forgot to check in randspawn benchmark file 2016-11-28 15:45:17 -07:00
jaffee
9cc3c76297 add RandomSetBits benchmark demonstrating seeds 2016-11-28 15:45:17 -07:00