Matt Jaffee
ef6db5cc1a
propogate updates to node details (not just additions and deletions)
...
to all nodes in cluster, not just coordinator
2018-12-04 14:03:14 -06:00
Cody Soyland
53dfccbde4
Merge branch 'master' into arm64-support
2018-11-30 11:05:04 -06:00
Cody Soyland
f0c6394c61
Use syscall.Dup3 on ARM64 as Dup2 is unsupported
2018-11-27 11:03:59 -06:00
Yuce Tekol
d543689868
updated translate keys test to include new keys
2018-11-26 17:52:53 +03:00
Yuce Tekol
eb9e609794
Merged with master
2018-11-26 17:03:38 +03:00
Ben Johnson
8e49332b25
Add distributed tracing.
2018-11-21 15:08:33 -06:00
Yuce Tekol
81354461a0
Merge branch 'master' into 1710-suppress-std-view-on-time-fields
2018-11-21 18:44:29 +03:00
Yuce Tekol
12112e0aef
Merged with master; check for empty roaring data
2018-11-21 18:22:40 +03:00
Yuce Tekol
ac91635628
Merged with master
2018-11-21 18:16:43 +03:00
Yuce Tekol
2c91bf69b3
Merge branch 'master' into translate-keys-endpoint
2018-11-21 16:38:23 +03:00
Yuce Tekol
9c05155db4
Added /internal/translate/keys endpoint
2018-11-21 16:35:50 +03:00
Yuce Tekol
1faa789b31
remove ImportRoaringRequestView type
2018-11-21 14:53:16 +03:00
Yuce Tekol
3d54f737cd
ditch OptFieldTypeTimeWithOptions
2018-11-20 23:21:09 +03:00
Matt Jaffee
77598c2cc6
dup log output onto stderr to catch panics in log file
2018-11-20 14:08:07 -06:00
Matt Jaffee
65f478470f
logging cleanup - start with lowercase unless reporting error or warning
2018-11-20 14:08:06 -06:00
Seebs
a203313143
move Logger and Stats to their own packages
...
I'd like to add stat tracking to Roaring, which means it
has to be able to import the stats package, which means
stats has to be a package rather than part of the pilosa
package. If stats stops being in pilosa, it still needs
a way to import logger, so logger also has to leave the
pilosa package. Then everything using them needs to import
them and use package selectors on their names.
This doesn't actually add the stats support to roaring,
it just makes it so there's a way to import the stats
code from something in the roaring package.
2018-11-15 15:10:44 -06:00
Yuce Tekol
0fe5d56f68
Merged with master
2018-11-15 21:19:58 +03:00
Matt Jaffee
90c5f64b19
filter memberlist debug and info logs, use t.Log instead of fmt in cluster tests
2018-11-12 14:01:57 -06:00
Yuce Tekol
1642e22872
fixed handler tests
2018-11-12 19:24:32 +03:00
Yuce Tekol
84c04900e1
Import roaring enpoint accepts a list of views
2018-11-12 18:43:59 +03:00
Matt Jaffee
deae8ce7c0
improvements to clustertests and fix cluster pause bug by state sharing
2018-11-09 11:28:19 -06:00
Yuce Tekol
7913a419ae
adds NoStandardView field option. Fixes #1710
2018-11-08 18:33:39 +03:00
Matt Jaffee
ec3982c0ff
pull out advertise URI changes
2018-11-02 16:10:39 -05:00
Matt Jaffee
d86e9ed3ea
add docker based cluster tests, remove proxy stuff, fix advertise
2018-11-02 14:41:42 -05:00
Matt Jaffee
62c1bfe90e
implement MustNewClusterWithProxy and drop/undrop for partitioning
2018-10-26 16:13:20 -05:00
Matt Jaffee
28591b4a91
WIP: figure out why config.Gossip.Port is 0 after cluster start
2018-10-24 16:56:32 -05:00
Matt Jaffee
8db7a78a93
unpushed WIP on cluster-tests
2018-10-23 11:10:24 -05:00
Travis Turner
42531f72fb
prevent closing os.Stdout or os.Stderr (used in verbose test logging)
2018-10-17 17:59:57 -05:00
Yuce Tekol
066c3a4853
Fixes #1660
2018-10-01 14:15:51 +03:00
Travis Turner
cdfcd6db5e
store remoteAvailableShards to file
2018-09-24 15:37:43 -05:00
Cody Soyland
e4a1281997
Merge branch 'master' into configurable-translate-map-size
2018-09-20 16:05:43 -05:00
Cody Soyland
52ba336461
Address code review feedback
2018-09-20 16:05:28 -05:00
Travis Turner
b86478c613
test to ensure views match UTC time
2018-09-19 16:17:09 -05:00
Cody Soyland
ebc4d7fc13
Set low map size for 32-bit
2018-09-19 13:37:42 -05:00
Cody Soyland
2394d36108
Adjust tests, fix 32-bit config
2018-09-19 13:30:22 -05:00
Cody Soyland
7a32745b28
Make translate map size configurable.
2018-09-19 12:35:00 -05:00
Matt Jaffee
7b0d4d75b4
remove validators on import-roaring and test handler
...
validators are for query args, not url vars. Also some misc cleanup and error
handling in the handler.
2018-09-13 13:14:35 -05:00
Matt Jaffee
a3243f99e1
linter fixes - reorder return vals, remove unused const
2018-09-12 13:24:59 -05:00
Travis Turner
d50a0e853c
change NewTranslateStore() to take an interface for backward compatibility
2018-08-13 12:04:22 -05:00
Travis Turner
b304de6536
Treat coordinator as primary translate store.
...
Daisy-chain other nodes based on their position in the cluster.
Deprecate the `primary-url` configuration option.
2018-08-13 11:06:16 -05:00
Matt Jaffee
1901ffada6
make sure cluster gets into DEGRADED state when adding nodes
...
previously, losing a node could cause the cluster to go from NORMAL->DEGRADED,
but adding a node would not cause it to go from STARTING->DEGRADED. Cody brought
this up in code review.
2018-08-08 19:42:30 -05:00
Matt Jaffee
bb32706cb6
support DEGRADED in removeNode
...
now, nodes which have failed and been removed from the running cluster state can
still be manually removed to trigger a cluster resize event. This is important
because otherwise there is no way to cause the cluster to resize itself if a
node fails and you don't want to add a node to replace it.
2018-08-06 16:55:23 -05:00
Matt Jaffee
ba5b46898f
fix determineClusterState bug and add more test cases
2018-08-06 14:55:38 -05:00
Matt Jaffee
48af3adc21
add degraded cluster state and handle node failure
...
cluster is in degraded state when some number of nodes greater than 0 but less
than replicaN have failed. This is sort of a hybrid of "STARTING" and "NORMAL"
states because we can still respond to queries as in the NORMAL state, but we
need to be alert to re-add nodes to the cluster if they come back online which
required some changes to the cluster logic.
In order to make debugging easier, the test.MustRunCluster functionality now
names the nodes in the cluster explicitly as "node0", "node1", etc. "node0" is
the coordinator.
A number of TODOs are left in the test for scenarios that need to be checked.
2018-08-06 11:57:24 -05:00
Cody Soyland
e76c523135
Merge branch 'master' into 1517-metalinter-unconvert
2018-08-02 11:45:24 -05:00
Cody Soyland
dd7b5f517b
Merge branch 'master' into 1513-metalinter-megacheck
2018-08-02 10:29:47 -05:00
Cody Soyland
c44bb65163
Add more time to sleep in translator tests due to CI failures
2018-07-31 20:39:05 -05:00
Cody Soyland
0816ea8ecb
Add sleep to test to wait for key replication
2018-07-31 12:11:21 -05:00
Cody Soyland
e79cd4b199
Add JSON parsing to translator test to verify keys
2018-07-31 11:40:30 -05:00
Cody Soyland
2739ce436c
Merge remote-tracking branch 'travisturner/translate-cluster-fix' into translate-cluster-fix
2018-07-31 08:36:31 -05:00
