Commit graph

119 commits

Author SHA1 Message Date
Travis Turner
0342da92bb
WIP: add tests for cluster resize
This commit adds support for allocating a gossip transport
and a server listener prior to opening server (and cluster).
Doing that allows tests to use a dynamically allocated port
by supplying bind port: 0.
2017-12-12 16:27:47 -06:00
Travis Turner
9667a04cad
Merge branch 'master' into cluster-resize 2017-12-08 17:56:31 -06:00
Travis Turner
cf1e41faf1
Merge branch 'master' into cluster-resize 2017-12-08 15:22:12 -06:00
Travis Turner
637111a76c
Change Broadcaster.SyndSync to send direct via http
as opposed to using memberlist's gossip broadcast.
Introduce a Gossiper interface for SendAsync gossip messages.
2017-12-08 09:00:47 -06:00
Todd Gruben
c14bc29041 added logging for node membership 2017-12-07 11:17:37 -06:00
Travis Turner
c9886b049b
Merge branch 'master' into cluster-resize working branch. 2017-12-04 22:18:57 -06:00
Travis Turner
9b54259cd7
Resume test: TestMain_SendReceiveMessage
Create a custom memberlist NetTransport (which will bind to an available
port when port = 0 in the configuration). This allows us to bind
to dynamic ports in tests while at the same time determining a valid
seed for the cluster.
2017-12-04 14:56:21 -06:00
Todd Gruben
f051f7ccea refactored httpclient handling 2017-12-01 16:00:12 -06:00
Travis Turner
8228ef2382
Add a Cluster.Static override for tests to treat static nodes as
Coordinator.
Refactor the Server.joining channel to be in Cluster instead.
2017-11-28 16:40:05 -06:00
Cody Soyland
dc7dd26955 Fix test for CountOpenFiles 2017-11-15 13:38:55 -06:00
Cody Soyland
a17b1b5b27 Simplify TestCountOpenFiles: Fragile in some environments due to unpredictable open file count 2017-11-14 14:57:32 -06:00
Travis Turner
1a965e7f9c
comment out test TestMain_SendReceiveMessage until addressing several issues 2017-11-13 15:55:01 -06:00
Cody Soyland
8c0d1ece55 Remove "plugins.path" configuration option
According to Todd, the current plugin direction is static and there is no need for dynamic loading, so this option is no longer needed.
2017-11-08 11:46:23 -06:00
Travis Turner
e641aa1d8a
Merge branch 'master' into 'cluster-resize' 2017-11-07 15:00:11 -06:00
Michael Baird
17da0443d3
Merge pull request #895 from raskle/diagnostics
Diagnostics
2017-11-06 11:30:38 -06:00
Travis Turner
f4b0729458
Rename structs and funcs.
NodeSet -> MemberSet
URISet -> NodeSet
AddNode -> AddNodeBasicSorted
AddHost -> AddNode
2017-10-30 13:03:55 -05:00
Travis Turner
ed1b4fcc2e
Copy fragment data from source nodes in resize instruction. 2017-10-30 13:01:57 -05:00
Travis Turner
2bd0677df9
Remove MaxSlice polling.
Add Schema to proto.
Update MaxSlices in proto to include both standard and inverse.
Update LocalStatus (shared in gossip) to include MaxSlices and Schema.
Encode InputDefinitions with Index.

TODO:
- make sure InputDefinitions are considered in LocalStatus merge.
- decide what to do about `/slices/max` endpoint. client.backup is using
  it.
2017-10-26 23:48:40 -05:00
Travis Turner
a8871ada6a
Convert Host to URI.
Fix all compile errors.
2017-10-25 11:52:55 -05:00
Travis
f1e3ac90d4
Determine cluster membership via gossip.
Handle resize cluster events.
Add Toplogy support.
Refactor FrameOptions.
Add tests.
2017-10-25 00:27:30 -05:00
Michael Baird
c14f72b66a changed the diagnostics configuration option to a boolean 2017-10-24 10:40:21 -05:00
Yuce Tekol
569cd90f59 Merge pull request #892 from yuce/client-refactoring
Internal Client refactoring
2017-10-24 02:46:02 +03:00
Michael Baird
8b4d2d6c85 Config option for diagnostics interval. Default to 1 hour 2017-10-18 10:26:27 -05:00
Michael Baird
3b4892f926 simplifying the diagnostics client. Using circuit breaker to manage the diagnostics http connection. 2017-10-18 10:26:27 -05:00
Michael Baird
32f1558737 Using MultiStatsClient add Diagnostics 2017-10-18 10:24:31 -05:00
Michael Baird
8b87886a68 simplifying the diagnostics client. Using circuit breaker to manage the diagnostics http connection. 2017-10-18 10:22:17 -05:00
Michael Baird
bf2827b273 Using MultiStatsClient add Diagnostics 2017-10-18 10:14:19 -05:00
Yuce Tekol
66650ec1f7
NewExecutor doesn't return an error; renamed NewClient to NewInternalHTTPClient 2017-10-18 17:38:20 +03:00
Yuce Tekol
838d56011c
Renamed Client to InternalHTTPClient 2017-10-17 16:04:42 +03:00
Yuce Tekol
9ac54c31b0
updated NewGossipNodeSet call in tests 2017-10-13 13:39:38 +03:00
Yuce Tekol
eec739c331
Adds gossip encryption key; copies Config.Gossip{Port,Seed} to Config.Gossip.{Port,Seed}, deprecates --gossip-port and --gossip-seed. Use --gossip.port and --gossip.seed 2017-10-13 13:30:41 +03:00
Yuce Tekol
e223ec3f9a
Rename Host -> URI 2017-10-12 15:49:34 +03:00
Yuce Tekol
65ad94c376
clusters with https + self signed certificates work (using --tls.skip-verify) 2017-10-10 04:48:15 +03:00
Yuce Tekol
3501732b19
https with signed certificates work 2017-10-08 21:11:19 +03:00
Yuce Tekol
a95b09d30d
more host string to uri changes 2017-10-04 15:29:00 +03:00
Yuce Tekol
1bedfd6585
use URI instead of host 2017-10-04 08:20:00 +03:00
Yuce Tekol
5760d89742
Initial TLS support 2017-10-02 15:53:50 +03:00
Travis
c4a4f0dcc4
don't normalize bind address after all, just have it use defaults when necessary 2017-08-07 08:25:35 -05:00
Travis
fcb311389e
added pilosa.NormalizeAddress() to address variations in the bind configuration 2017-08-07 08:25:35 -05:00
Travis
a3b1b2ee1a
DefaultClusterType = ClusterGossip
This commit removes the `httpbroadcast` NodeSet, sets the default cluster type
to `gossip`, and uses the `static` cluster type for most test cases.
2017-08-07 08:25:35 -05:00
Travis
b91da2d0a4
Merge branch 'master' into input-definition 2017-07-26 14:44:31 -05:00
Travis
b6896482b9
move InternalPort config option out from under cluster and up to the root of Config 2017-07-24 17:28:23 -05:00
Michael Baird
1569c932ff Merge branch 'master' into input-definition 2017-07-18 14:51:15 -05:00
Michael Baird
4b53ec1f9c const cluster types, and more validation tests 2017-07-11 14:17:06 -05:00
Michael Baird
baff53ae3d config test and validate 2017-07-11 11:31:27 -05:00
Linh Vo
6a50427629 rename Config's fields 2017-07-10 13:34:10 -05:00
Linh Vo
95166fd0ee revert config and fix json tag 2017-07-10 11:28:32 -05:00
Michael Baird
504d25b36f Merge remote-tracking branch 'origin/master' into input-definition
Conflicts:
	handler_test.go
	index_test.go
2017-06-29 14:32:50 -05:00
Alan Bernstein
d96a121347 Simplify function arguments 2017-06-27 09:52:40 -05:00
Alan Bernstein
2fe21231fc Deduplicate logfile opening code 2017-06-23 18:03:28 -05:00