Commit graph

3937 commits

Author SHA1 Message Date
Matt Jaffee
e16c43c3bc
Merge branch 'master' into 1492-ae-and-resize 2018-08-20 09:13:35 -05:00
Travis Turner
f0baba9f23
Merge pull request #1603 from bmuller/require-valid-port
Require a valid port that isn't greater than 65,535
2018-08-17 08:27:12 -05:00
Brian Muller
6537c6c55a Require a valid port that isn't greater than 65,535 2018-08-16 21:05:41 -04:00
Travis Turner
99e62dddb4
Merge pull request #1602 from travisturner/sync-views
adds view parameter to sync logic for syncing time fields
2018-08-16 13:45:37 -05:00
Travis Turner
f1a460aca7
adds view parameter to sync logic for syncing time fields 2018-08-16 11:27:08 -05:00
Travis Turner
ac6feba982
Merge pull request #1601 from travisturner/import-key-values
Import key values
2018-08-15 16:44:38 -05:00
Travis Turner
177f25ee44
Add tests for importing value with column keys into integer fields.
Fix a bug in protofuf decoding of pilosa.Row.
2018-08-15 16:00:32 -05:00
Travis Turner
bf4e2e598b
add support for column keys when importing to int fields 2018-08-15 16:00:31 -05:00
Travis Turner
227e3bfc9f
Merge pull request #1599 from travisturner/import-key-cli
Support keys on import CLI
2018-08-15 15:59:35 -05:00
Travis Turner
f547cf48ce
change t.Fatal() to t.Fatalf() 2018-08-15 15:36:55 -05:00
Travis Turner
1deb42a24a
adjust test to allow time for translation replication 2018-08-15 15:15:51 -05:00
Travis Turner
2f892e5e80
change string-keys DEPRECATED message to REMOVED 2018-08-15 14:55:02 -05:00
Travis Turner
6a327a26fe
add deprecation warnings for --string-keys flag 2018-08-15 10:31:27 -05:00
Travis Turner
862dabe27d
address review comments 2018-08-14 14:37:51 -05:00
Travis Turner
0a6f0e92d8
add tests to cover the coordinator logic for multi-node clusters 2018-08-14 13:58:37 -05:00
Travis Turner
fd96d3a02e
This commit ensures that keyed imports are sent to the coordinator
node (as opposed to sending to shard0, which may or may not be the
coordinator). It adds a `Nodes()` method to the `InternalClient`
which is used by the importer to determine which node is the
coordinator.
2018-08-14 12:34:17 -05:00
Travis Turner
3793719485
fix conflicts 2018-08-14 09:37:25 -05:00
Travis Turner
1feebc890b
fix outdated test 2018-08-14 09:32:40 -05:00
Ben Johnson
a31a08c330
Support keys on import CLI. 2018-08-14 09:32:39 -05:00
Travis Turner
f278af6194
Merge pull request #1582 from travisturner/coordinator-as-primary
Treat coordinator as primary translate store.
2018-08-13 13:15:39 -05:00
Travis Turner
d50a0e853c
change NewTranslateStore() to take an interface for backward compatibility 2018-08-13 12:04:22 -05:00
Travis Turner
debd470211
replace api.server.holder with api.holder 2018-08-13 11:06:16 -05:00
Travis Turner
ceaf97de60
add translate tests to ensure that adding/removing replica nodes behaves as expected 2018-08-13 11:06:16 -05:00
Travis Turner
b304de6536
Treat coordinator as primary translate store.
Daisy-chain other nodes based on their position in the cluster.
Deprecate the `primary-url` configuration option.
2018-08-13 11:06:16 -05:00
Matt Jaffee
ab63c8e7b6
add forgotten server changes which support AE test 2018-08-09 16:07:05 -05:00
Matt Jaffee
b761121f47
test antiEntropy set to 0 works as expected 2018-08-09 15:54:31 -05:00
Matthew Jaffee
6070db077c
Merge pull request #1584 from jaffee/1249-node-failure
Add DEGRADED cluster state and handle gossip NodeLeave events correctly
2018-08-09 09:39:23 -05:00
Matt Jaffee
1901ffada6
make sure cluster gets into DEGRADED state when adding nodes
previously, losing a node could cause the cluster to go from NORMAL->DEGRADED,
but adding a node would not cause it to go from STARTING->DEGRADED. Cody brought
this up in code review.
2018-08-08 19:42:30 -05:00
Matt Jaffee
6e99a8757d
remove unnecessary memberlist constraint 2018-08-08 19:25:54 -05:00
Matt Jaffee
287ea370fd
add cluster tests for anti entropy abort 2018-08-08 15:11:52 -05:00
Matt Jaffee
0e467e5492
rename cluster.nodes and fix race in API 2018-08-08 15:11:39 -05:00
Matt Jaffee
16eff6de8c
prevent anti entropy and cluster resize from running simultaneously 2018-08-08 14:41:54 -05:00
Matt Jaffee
bb32706cb6
support DEGRADED in removeNode
now, nodes which have failed and been removed from the running cluster state can
still be manually removed to trigger a cluster resize event. This is important
because otherwise there is no way to cause the cluster to resize itself if a
node fails and you don't want to add a node to replace it.
2018-08-06 16:55:23 -05:00
Matt Jaffee
ba5b46898f
fix determineClusterState bug and add more test cases 2018-08-06 14:55:38 -05:00
Matt Jaffee
48af3adc21
add degraded cluster state and handle node failure
cluster is in degraded state when some number of nodes greater than 0 but less
than replicaN have failed. This is sort of a hybrid of "STARTING" and "NORMAL"
states because we can still respond to queries as in the NORMAL state, but we
need to be alert to re-add nodes to the cluster if they come back online which
required some changes to the cluster logic.

In order to make debugging easier, the test.MustRunCluster functionality now
names the nodes in the cluster explicitly as "node0", "node1", etc. "node0" is
the coordinator.

A number of TODOs are left in the test for scenarios that need to be checked.
2018-08-06 11:57:24 -05:00
Cody Soyland
205857e765
Merge pull request #1544 from codysoyland/1517-metalinter-unconvert
Fix linter issues: unconvert
2018-08-02 12:17:27 -05:00
Cody Soyland
e76c523135
Merge branch 'master' into 1517-metalinter-unconvert 2018-08-02 11:45:24 -05:00
Cody Soyland
c31b8c9b79
Merge pull request #1543 from codysoyland/1513-metalinter-megacheck
Fix linter issues: megacheck (unused/staticcheck/gosimple)
2018-08-02 11:44:46 -05:00
Cody Soyland
d344876587 Increase gometalinter deadline 2018-08-02 10:59:29 -05:00
Cody Soyland
f6855fac62 Remove unused newMockReadCloser 2018-08-02 10:59:16 -05:00
Cody Soyland
dd7b5f517b
Merge branch 'master' into 1513-metalinter-megacheck 2018-08-02 10:29:47 -05:00
Cody Soyland
1774efaf19
Merge pull request #1571 from codysoyland/skip-flawed-translator-test
Skip flawed translator test
2018-08-01 11:23:05 -05:00
Cody Soyland
495b4259fd Skip flawed translator test 2018-08-01 10:57:56 -05:00
Cody Soyland
edf6fa9c67
Merge pull request #1568 from codysoyland/translator-test-sleep
Add more time to sleep in translator tests due to CI failures
2018-07-31 21:05:49 -05:00
Cody Soyland
c44bb65163 Add more time to sleep in translator tests due to CI failures 2018-07-31 20:39:05 -05:00
Travis Turner
5802ba37b2
Merge pull request #1552 from travisturner/translate-cluster-fix
Translate cluster fix
2018-07-31 16:39:33 -05:00
Travis Turner
2dd655f0e9
move sleep to be after replica sync 2018-07-31 16:01:42 -05:00
Cody Soyland
68dc6489ce
Merge branch 'master' into translate-cluster-fix 2018-07-31 15:13:31 -05:00
Cody Soyland
672563891e
Merge pull request #1558 from codysoyland/go-master-error
Use string prefix instead of equality so json error message will pass on all Go versions
2018-07-31 15:13:15 -05:00
Cody Soyland
ba3bda6ac2 Use string prefix instead of equality so json error message will pass on all Go versions 2018-07-31 14:16:17 -05:00