Commit graph

782 commits

Author SHA1 Message Date
Matthew Jaffee
bde6f03c81 Merge pull request #208 from jaffee/171-cluster-creation
#171 cluster creation
2016-12-19 11:12:38 -06:00
Matthew Jaffee
d8f5b7d78b Merge pull request #174 from jaffee/fix-errgroup-dep
copy errgroup code to bench and remove giant blob of dependencies
2016-12-16 13:55:09 -06:00
jaffee
0c6e6e4f44 creator can set GOMAXPROCS for remote pilosa nodes 2016-12-14 15:05:50 -06:00
jaffee
9d5acdeecd cleanup cluster shutdown and extra logging 2016-12-14 10:53:14 -06:00
jaffee
968e82d1ad clean up remote create, kill remote cluster
Had to jump through some hoops to kill the remote cluster reliably. Not all ssh
server implementations respect signals, so in order to kill the cluster, we
request a pty for the ssh session. This allows us to send the byte 0x03 which is
effectively the same has hitting Ctrl-c in an interactive ssh session. With a
pty, just closing the session also seems to kill the remote process.
2016-12-13 16:36:52 -06:00
jaffee
6829f7cdd0 create - start cluster over ssh when given hosts 2016-12-13 10:14:09 -06:00
jaffee
e72e82ca7f remove separate create() and get bspawn working again 2016-12-12 16:29:40 -06:00
jaffee
bd78a7c1b9 json output and local cluster log handling 2016-12-12 11:32:56 -06:00
Matthew Jaffee
40bf1347f9 Merge pull request #196 from jaffee/195-fix-context
thread context through Benchmarks
2016-12-08 11:09:36 -06:00
jaffee
53171da640 thread context through Benchmarks
Also fix a few ignored errors, an issue with pilosactl usage string, a broken
test, and a mistaken import.
2016-12-08 11:02:14 -06:00
tgruben
6e71afc391 Merge pull request #191 from jaffee/166-single-slice
166 single slice
2016-12-08 10:31:22 -06:00
Alan Bernstein
060f06c1dc Merge stats updates 2016-12-07 17:30:08 -06:00
alanbernstein
39f3ac305a Merge pull request #192 from jaffee/alan-enhanced-stats
Alan enhanced stats
2016-12-07 17:18:43 -06:00
Travis Turner
94282ca4d2 Merge pull request #189 from jaffee/187-benchmark-docs
187 benchmark docs
2016-12-07 15:27:41 -06:00
Alan Bernstein
75d282a478 Move sqrt out of Add() 2016-12-07 12:45:14 -06:00
Alan Bernstein
51faa59ada Add standard deviation to stats 2016-12-07 12:44:52 -06:00
jaffee
4c67cb30c0 make results nicer 2016-12-07 12:09:18 -06:00
tgruben
010a71263b Merge pull request #186 from jaffee/170-import-benchmark
170 import benchmark
2016-12-07 10:47:46 -06:00
jaffee
b4bb9cf70d add slice height benchmark 2016-12-06 17:20:38 -06:00
jaffee
af1d35affc import benchmark sort by profile id after bitmap id 2016-12-06 16:11:00 -06:00
jaffee
bde927cdf1 clean up benchmark docs a bit 2016-12-06 11:00:59 -06:00
jaffee
cc55d32059 first cut at benchmark readme 2016-12-06 10:49:00 -06:00
jaffee
838941b26a wire up import benchmark, fix bug with ImportCommand.Host
also add some config metadata to results in order to distinguish them
2016-12-06 10:16:28 -06:00
jaffee
e5edf3e432 add import benchmark 2016-12-05 17:37:33 -06:00
jaffee
859a459ff6 copy errgroup code to bench and remove giant blob of dependencies 2016-12-01 16:58:56 -07:00
jaffee
fe28a095a5 add option to save all stats 2016-12-01 15:46:41 -07:00
Matthew Jaffee
98fcff8564 Merge pull request #2 from codysoyland/benchmark-runner
Add missing dependency golang.org/x/sync/errgroup
2016-11-29 15:23:07 -07:00
Cody Soyland
c6773f9faa Merge branch 'master' into benchmark-runner 2016-11-29 16:10:56 -06:00
Matthew Jaffee
306c64793e Merge pull request #147 from codysoyland/145-remove-godep
Remove Godep now that we use Glide
2016-11-29 15:06:30 -07:00
Cody Soyland
f2d44333cf Modify docs for people scared of piping to bash ;) 2016-11-29 16:04:19 -06:00
Cody Soyland
a4279eb215 Remove Godep now that we use Glide 2016-11-29 15:15:11 -06:00
Matthew Jaffee
e833326887 Merge pull request #146 from codysoyland/145-package-manager
Switch to Glide.sh for dependency management (Fixes #145)
2016-11-29 14:06:58 -07:00
Cody Soyland
dcec3430e3 Add missing dependency golang.org/x/sync/errgroup 2016-11-29 13:37:27 -06:00
Cody Soyland
34a3d1745d Switch to Glide.sh for dependency management (Fixes #145) 2016-11-29 13:35:23 -06:00
Cody Soyland
23ab7063b8 Switch to Glide.sh for dependency management (Fixes #145) 2016-11-29 12:36:58 -06:00
jaffee
1d0a314287 rename imports umbel->pilosa 2016-11-28 15:45:18 -07:00
jaffee
86e226d574 better documentation for bagent and bspawn 2016-11-28 15:45:18 -07:00
jaffee
a3b69f9066 rename bench commands and args
lower case and dash separated
2016-11-28 15:45:18 -07:00
jaffee
ea88941cff rename QueryMaker -> QueryGenerator 2016-11-28 15:45:18 -07:00
jaffee
406efcaca3 fixup imports in multidb 2016-11-28 15:45:18 -07:00
jaffee
6be7fb9bc2 use errgroup to simplify parallel benchmark Init 2016-11-28 15:45:18 -07:00
jaffee
aa2b4949d8 add random query benchmark 2016-11-28 15:45:18 -07:00
jaffee
861aee9a94 add some benchmark helpers for randomly generating queries 2016-11-28 15:45:18 -07:00
jaffee
df6e519222 bspawn can create and tear down cluster for benchmarks 2016-11-28 15:45:18 -07:00
jaffee
9bf213af94 add fine grained stats within benchmarks 2016-11-28 15:45:17 -07:00
jaffee
65ac486b4c refactor Init and provide ClientType option
Benchmark implementations can now use 'HasClient' as a component which provides
an Init method which sets up the pilosa client in a configurable way.
Implementations must still expose the ClientType argument through ConsumeFlags
and describe it in Usage()
2016-11-28 15:45:17 -07:00
jaffee
2f4171bba8 add agentNum to benchmark Init as well as run 2016-11-28 15:45:17 -07:00
jaffee
0dc8548f45 split benchmarks into separate files 2016-11-28 15:45:17 -07:00
jaffee
256d516726 fix broken context stuff after rebase 2016-11-28 15:45:17 -07:00
jaffee
86d408310c add MultiDBSetBits benchmark 2016-11-28 15:45:17 -07:00