Matt Jaffee
deae8ce7c0
improvements to clustertests and fix cluster pause bug by state sharing
2018-11-09 11:28:19 -06:00
Matt Jaffee
ec3982c0ff
pull out advertise URI changes
2018-11-02 16:10:39 -05:00
Matt Jaffee
d86e9ed3ea
add docker based cluster tests, remove proxy stuff, fix advertise
2018-11-02 14:41:42 -05:00
Matt Jaffee
62c1bfe90e
implement MustNewClusterWithProxy and drop/undrop for partitioning
2018-10-26 16:13:20 -05:00
Matt Jaffee
28591b4a91
WIP: figure out why config.Gossip.Port is 0 after cluster start
2018-10-24 16:56:32 -05:00
Matt Jaffee
8db7a78a93
unpushed WIP on cluster-tests
2018-10-23 11:10:24 -05:00
Travis Turner
42531f72fb
prevent closing os.Stdout or os.Stderr (used in verbose test logging)
2018-10-17 17:59:57 -05:00
Yuce Tekol
066c3a4853
Fixes #1660
2018-10-01 14:15:51 +03:00
Travis Turner
cdfcd6db5e
store remoteAvailableShards to file
2018-09-24 15:37:43 -05:00
Cody Soyland
e4a1281997
Merge branch 'master' into configurable-translate-map-size
2018-09-20 16:05:43 -05:00
Cody Soyland
52ba336461
Address code review feedback
2018-09-20 16:05:28 -05:00
Travis Turner
b86478c613
test to ensure views match UTC time
2018-09-19 16:17:09 -05:00
Cody Soyland
ebc4d7fc13
Set low map size for 32-bit
2018-09-19 13:37:42 -05:00
Cody Soyland
2394d36108
Adjust tests, fix 32-bit config
2018-09-19 13:30:22 -05:00
Cody Soyland
7a32745b28
Make translate map size configurable.
2018-09-19 12:35:00 -05:00
Matt Jaffee
7b0d4d75b4
remove validators on import-roaring and test handler
...
validators are for query args, not url vars. Also some misc cleanup and error
handling in the handler.
2018-09-13 13:14:35 -05:00
Matt Jaffee
a3243f99e1
linter fixes - reorder return vals, remove unused const
2018-09-12 13:24:59 -05:00
Travis Turner
d50a0e853c
change NewTranslateStore() to take an interface for backward compatibility
2018-08-13 12:04:22 -05:00
Travis Turner
b304de6536
Treat coordinator as primary translate store.
...
Daisy-chain other nodes based on their position in the cluster.
Deprecate the `primary-url` configuration option.
2018-08-13 11:06:16 -05:00
Matt Jaffee
1901ffada6
make sure cluster gets into DEGRADED state when adding nodes
...
previously, losing a node could cause the cluster to go from NORMAL->DEGRADED,
but adding a node would not cause it to go from STARTING->DEGRADED. Cody brought
this up in code review.
2018-08-08 19:42:30 -05:00
Matt Jaffee
bb32706cb6
support DEGRADED in removeNode
...
now, nodes which have failed and been removed from the running cluster state can
still be manually removed to trigger a cluster resize event. This is important
because otherwise there is no way to cause the cluster to resize itself if a
node fails and you don't want to add a node to replace it.
2018-08-06 16:55:23 -05:00
Matt Jaffee
ba5b46898f
fix determineClusterState bug and add more test cases
2018-08-06 14:55:38 -05:00
Matt Jaffee
48af3adc21
add degraded cluster state and handle node failure
...
cluster is in degraded state when some number of nodes greater than 0 but less
than replicaN have failed. This is sort of a hybrid of "STARTING" and "NORMAL"
states because we can still respond to queries as in the NORMAL state, but we
need to be alert to re-add nodes to the cluster if they come back online which
required some changes to the cluster logic.
In order to make debugging easier, the test.MustRunCluster functionality now
names the nodes in the cluster explicitly as "node0", "node1", etc. "node0" is
the coordinator.
A number of TODOs are left in the test for scenarios that need to be checked.
2018-08-06 11:57:24 -05:00
Cody Soyland
e76c523135
Merge branch 'master' into 1517-metalinter-unconvert
2018-08-02 11:45:24 -05:00
Cody Soyland
dd7b5f517b
Merge branch 'master' into 1513-metalinter-megacheck
2018-08-02 10:29:47 -05:00
Cody Soyland
c44bb65163
Add more time to sleep in translator tests due to CI failures
2018-07-31 20:39:05 -05:00
Cody Soyland
0816ea8ecb
Add sleep to test to wait for key replication
2018-07-31 12:11:21 -05:00
Cody Soyland
e79cd4b199
Add JSON parsing to translator test to verify keys
2018-07-31 11:40:30 -05:00
Cody Soyland
2739ce436c
Merge remote-tracking branch 'travisturner/translate-cluster-fix' into translate-cluster-fix
2018-07-31 08:36:31 -05:00
Travis Turner
3ffafaca4a
ignore remote translation
2018-07-30 11:45:34 -05:00
Cody Soyland
ca800c683e
Add test for cluster translator
2018-07-24 14:57:06 -05:00
Cody Soyland
dc50204846
Fix linter issues: unconvert
2018-07-20 11:51:55 -05:00
Cody Soyland
990780bd93
Fix linter issues: staticcheck (covered by megacheck, along with gosimple and unused)
2018-07-20 11:19:24 -05:00
Cody Soyland
e9523063b5
Fix linter issues: unused
2018-07-20 10:33:29 -05:00
Cody Soyland
de99b5720f
Fix linter issues: vet
2018-07-19 11:37:50 -05:00
Cody Soyland
0b86bbb4f5
Fix linter issues: gochecknoinits
2018-07-18 11:58:27 -05:00
Cody Soyland
c464e0fe64
Fix linter issues: gofmt
2018-07-16 16:45:42 -05:00
Matt Jaffee
b7e5f8842e
add a configurable timeout to http handler closing
...
refactor handler Close func to use errgroup to be a bit less messy.
refactor pilosa.Server closing to actually return an underlying error if one occurs
add option to pilosa/test.Cluster and pilosa/server.Command to control close
timeout. currently is only used by the http handler, but conceivably could be
passed as a parameter to other subsystems of pilosa/server.Command
2018-07-10 15:16:35 -05:00
Travis Turner
1723616aac
add gossip Closer
2018-07-10 11:41:54 -05:00
Travis Turner
d22507d36d
rename gossip.NewGossipMemberSet to gossip.NewMemberSet
2018-07-09 17:05:58 -05:00
Travis Turner
babdb5ff4e
adjust test to account for new source of error downstream
2018-07-06 17:38:06 -05:00
Cody Soyland
50d57ec229
Unexport server.DefaultDiagnosticsInterval (in release tag)
2018-07-05 23:11:57 -05:00
Cody Soyland
167e41787f
Unexport server.NewStatsClient
2018-07-05 23:11:56 -05:00
Cody Soyland
94e633b7eb
Unexport server.DefaultDiagnosticsInterval
2018-07-05 23:11:56 -05:00
Cody Soyland
6023474ed4
Unexport server.Command.SetupNetworking
2018-07-05 23:11:56 -05:00
Matt Jaffee
d032c8941f
Merge branch 'develop' into dead-code-removal
2018-07-05 18:02:39 -05:00
Matt Jaffee
21cf6b6e57
remove URI getters since the fields were exported for serialization
2018-07-05 17:59:18 -05:00
Matt Jaffee
0a94d2f10d
Merge branch 'develop' into core-structs
2018-07-05 16:38:14 -05:00
Matt Jaffee
a164233c92
fix handler tests not to use internal and fix bug
2018-07-05 16:21:27 -05:00
Cody Soyland
da4cd84820
Remove some dead code
2018-07-05 15:31:07 -05:00