Matt Jaffee
495af54c10
Merge branch 'master' into roaring-import
2018-09-13 15:50:16 -05:00
Matt Jaffee
870c5e131f
replace waitgroup with errgroup to avoid race on err
2018-09-13 15:27:00 -05:00
Matt Jaffee
f943c17e0b
ImportRoaring, add remote arg, fix data copy bug
...
also, handle err properly in client method instead of discarding.
2018-09-13 15:05:05 -05:00
Matt Jaffee
b412309447
rename standard roaring to "official" throughout
2018-09-13 13:38:18 -05:00
Matt Jaffee
7b0d4d75b4
remove validators on import-roaring and test handler
...
validators are for query args, not url vars. Also some misc cleanup and error
handling in the handler.
2018-09-13 13:14:35 -05:00
Matt Jaffee
fd655c998e
rename all instances of roaringbytes
...
function names now importRoaring and byte slice args are just called data. Also
renamed http endpoint from /importroaring to /import-roaring
2018-09-13 12:27:23 -05:00
Matt Jaffee
f006df7758
re-order ImportRoaringBytes args to be more consistent
2018-09-13 10:39:00 -05:00
Matt Jaffee
c6817340c7
rename sliceWidth->shardWidth
2018-09-13 10:31:58 -05:00
Matt Jaffee
3bc9c66f5e
remove some naked returns and simplify
2018-09-12 17:21:17 -05:00
Matt Jaffee
b5a14de1fd
roaring import: fix api doc, refactor/rename, test merge
2018-09-12 16:11:51 -05:00
Matt Jaffee
8254d0fadd
improve import roaring docs, check errors
2018-09-12 12:08:57 -05:00
Matt Jaffee
cf47950bd7
gofmt all
2018-09-12 10:06:03 -05:00
Travis Turner
f7abf60627
add lock around existencFld
2018-09-11 15:15:37 -05:00
Travis Turner
9b4c67ee60
rename notnull to exists
2018-09-11 15:15:37 -05:00
Travis Turner
3d7fc0c1c6
remove unnecessary timestamp slice allocation
2018-09-11 15:14:58 -05:00
Travis Turner
4c67cb18ed
update notnull field on imports
2018-09-11 15:13:56 -05:00
Yuce Tekol
408a3531ec
updated comment
2018-09-11 22:18:31 +03:00
Yuce Tekol
70d386039f
trivial
2018-09-11 20:47:15 +03:00
Yuce Tekol
465028e9c3
Renamed Query to Opt; added multiple Opt test
2018-09-11 17:19:12 +03:00
Yuce Tekol
70ceb5809b
Added columnAttrs to Query call
2018-09-11 11:42:00 +03:00
Todd Gruben
93e5767325
cleanup #1622
2018-09-06 16:27:10 -05:00
Travis Turner
8a1f8659fa
change test to use exported UnmarshalStandardRoaring()
2018-09-05 10:13:15 -05:00
Todd Gruben
cc80e0b0e4
initial support for bulk importing standard roaring files per shard
2018-09-05 10:13:15 -05:00
Ben Johnson
f4c9c0fed3
Maintain available shards set.
...
This commit removes the previous `MaxShard` tracking and replaces
it with an `Available Shards` set tracking. This allows sparse shard
tracking without implicitly tracking all shards in between.
2018-08-22 07:57:58 -06:00
Travis Turner
6b75988b71
add key translation to exports
2018-08-20 13:40:58 -05:00
Matt Jaffee
e16c43c3bc
Merge branch 'master' into 1492-ae-and-resize
2018-08-20 09:13:35 -05:00
Travis Turner
f1a460aca7
adds view parameter to sync logic for syncing time fields
2018-08-16 11:27:08 -05:00
Travis Turner
bf4e2e598b
add support for column keys when importing to int fields
2018-08-15 16:00:31 -05:00
Travis Turner
3793719485
fix conflicts
2018-08-14 09:37:25 -05:00
Ben Johnson
a31a08c330
Support keys on import CLI.
2018-08-14 09:32:39 -05:00
Travis Turner
debd470211
replace api.server.holder with api.holder
2018-08-13 11:06:16 -05:00
Travis Turner
b304de6536
Treat coordinator as primary translate store.
...
Daisy-chain other nodes based on their position in the cluster.
Deprecate the `primary-url` configuration option.
2018-08-13 11:06:16 -05:00
Matt Jaffee
0e467e5492
rename cluster.nodes and fix race in API
2018-08-08 15:11:39 -05:00
Matt Jaffee
bb32706cb6
support DEGRADED in removeNode
...
now, nodes which have failed and been removed from the running cluster state can
still be manually removed to trigger a cluster resize event. This is important
because otherwise there is no way to cause the cluster to resize itself if a
node fails and you don't want to add a node to replace it.
2018-08-06 16:55:23 -05:00
Matt Jaffee
48af3adc21
add degraded cluster state and handle node failure
...
cluster is in degraded state when some number of nodes greater than 0 but less
than replicaN have failed. This is sort of a hybrid of "STARTING" and "NORMAL"
states because we can still respond to queries as in the NORMAL state, but we
need to be alert to re-add nodes to the cluster if they come back online which
required some changes to the cluster logic.
In order to make debugging easier, the test.MustRunCluster functionality now
names the nodes in the cluster explicitly as "node0", "node1", etc. "node0" is
the coordinator.
A number of TODOs are left in the test for scenarios that need to be checked.
2018-08-06 11:57:24 -05:00
Travis Turner
3ffafaca4a
ignore remote translation
2018-07-30 11:45:34 -05:00
Cody Soyland
5410dcd6b1
Fix errant references of server.primaryTranslateStore to server.translateFile
2018-07-30 11:45:34 -05:00
Cody Soyland
f9625ef4fa
Fix linter issues: unparam
2018-07-17 12:05:07 -05:00
Cody Soyland
c464e0fe64
Fix linter issues: gofmt
2018-07-16 16:45:42 -05:00
Cody Soyland
4aa8a41fa0
Unexport NewNotFoundError
2018-07-05 23:11:56 -05:00
Cody Soyland
a1fc587577
Unexport NewApiMethodNotAllowedError
2018-07-05 23:11:56 -05:00
Cody Soyland
0648d0fc75
Unexport Holder.RecalculateCaches
2018-07-05 23:11:56 -05:00
Cody Soyland
ba9c5193b5
Unexport Field.ImportValue
2018-07-05 23:11:56 -05:00
Cody Soyland
7559382115
Unexport AttrBlocks
2018-07-05 23:11:56 -05:00
Cody Soyland
b4011778dd
Unexport APIOption, b.BTCIterator, API.Holder, API.Serializer, APIOption, http.Handler.API
2018-07-05 23:11:56 -05:00
Matt Jaffee
21bfa5df77
remove Holder from API
2018-07-05 20:58:25 -05:00
Travis Turner
c10cdc9d22
exclude views from http schema output
2018-07-05 19:15:34 -05:00
Matt Jaffee
0a94d2f10d
Merge branch 'develop' into core-structs
2018-07-05 16:38:14 -05:00
Matt Jaffee
db2a53223d
remove internal references from api and http/*
2018-07-05 16:02:18 -05:00
Matt Jaffee
bbb93abd57
remove lots of unused code
2018-07-05 15:35:32 -05:00
