Cody Soyland
fdbfc68f7c
Add license headers to files missing them and CI check to verify they are present. Fixes #1633
2019-04-12 11:30:41 -05:00
Cody Soyland
188b977633
Add go module support
2019-01-29 14:53:03 -06:00
Yuce Tekol
65c30283d7
adds tests for GroupBy with keys; removes unused Bit message from proto
2019-01-03 15:20:02 +03:00
Travis Turner
d28170ddc6
Syncs AvailableShards when handling a ResizeInstruction.
...
There was a situation where availableShards on a new
node were not in sync with the cluster, so queries
following a resize were incorrect.
- Start a one-node cluster.
- Write data to shards 0 and 1
- Start a second node.
In the case where the hash algo was moving shard 0 to
node1, then node1 only knew about shard 0, so queries
to node1 would be incomplete.
This PR modifies the ResizeInstruction message to replace
`Schema` with `NodeStatus` (which contains both `Schema` and
`AvailableShards`). So now when a resize instruction is received,
the receiving node is able to sync its schema and availableShards.
2018-12-18 08:34:48 -06:00
Matt Jaffee
7e6c406212
fix bug where cluster goes into RESIZING instead of NORMAL
...
running
"make clustertests
DOCKER_COMPOSE=internal/clustertests/docker-compose-replication2.yml"
shows this issue (just remove the change in cluster.go).
Also removed two unrelated lines of code that appear to be doing absolutely nothing.
2018-12-11 09:22:03 -06:00
Yuce Tekol
eb9e609794
Merged with master
2018-11-26 17:03:38 +03:00
Yuce Tekol
81354461a0
Merge branch 'master' into 1710-suppress-std-view-on-time-fields
2018-11-21 18:44:29 +03:00
Yuce Tekol
ac91635628
Merged with master
2018-11-21 18:16:43 +03:00
Yuce Tekol
9c05155db4
Added /internal/translate/keys endpoint
2018-11-21 16:35:50 +03:00
Yuce Tekol
46c22a101f
updated protobuf generated files
2018-11-20 19:01:20 +03:00
Yuce Tekol
0fe5d56f68
Merged with master
2018-11-15 21:19:58 +03:00
Matt Jaffee
bc8b991220
rename Dockerfile-withgo to Dockerfile-clustertests
2018-11-13 09:31:16 -06:00
Matt Jaffee
0d4a46af97
use internal client instead of go-pilosa, use ADD instead of wget
2018-11-13 09:24:35 -06:00
Matt Jaffee
37ac8b7a93
better use of docker-compose opts per code review
2018-11-12 17:44:23 -06:00
Matt Jaffee
90c5f64b19
filter memberlist debug and info logs, use t.Log instead of fmt in cluster tests
2018-11-12 14:01:57 -06:00
Yuce Tekol
84c04900e1
Import roaring enpoint accepts a list of views
2018-11-12 18:43:59 +03:00
Matt Jaffee
9c9b1c5afe
Merge branch 'master' into cluster-tests
2018-11-09 12:23:21 -06:00
Matt Jaffee
deae8ce7c0
improvements to clustertests and fix cluster pause bug by state sharing
2018-11-09 11:28:19 -06:00
Yuce Tekol
7913a419ae
adds NoStandardView field option. Fixes #1710
2018-11-08 18:33:39 +03:00
Travis Turner
be202a61a7
upgrade to protoc 3.6.1. (also updated protoc-gen-gofast).
2018-11-06 14:01:09 -06:00
Matt Jaffee
6d821afed9
add note on skipped cluster test
2018-11-02 16:13:03 -05:00
Matt Jaffee
02aee931a1
few small fixes
2018-11-02 16:03:50 -05:00
Matt Jaffee
d86e9ed3ea
add docker based cluster tests, remove proxy stuff, fix advertise
2018-11-02 14:41:42 -05:00
Matt Jaffee
ec08930c30
Merge branch 'master' into cluster-tests
2018-10-26 16:14:00 -05:00
Matt Jaffee
af7ece74fd
test drop and undrop in udproxy.
2018-10-26 09:17:26 -05:00
Matt Jaffee
671420f31d
add custom json marshal for FieldRow
2018-10-24 17:11:45 -05:00
Matt Jaffee
f643487ce0
add initial UDP proxy code to support proxying/partitioning memberlist
2018-10-24 16:56:07 -05:00
Matt Jaffee
63b3954117
Merge branch 'master' into new-rows-iterate
2018-10-18 14:37:28 -05:00
Ben Johnson
f8608227d1
Add DeleteAvailableShard()
...
This commit adds the ability to remove an 'available shard'
from the shard cache. This does not affect shards known to be
available because of local data.
2018-10-17 08:50:06 -06:00
Travis Turner
71ad297450
change Rows() to RowIDs() and add RowIdentifiers return type to hold row keys
2018-09-18 12:45:09 -05:00
Travis Turner
f0666b2be0
change GroupByCounts to []GroupCount
2018-09-18 12:39:09 -05:00
Travis Turner
96b4086360
plug in in translation. adjust output format.
2018-09-18 12:37:26 -05:00
Travis Turner
e1b938e52c
add FieldRow struct to replace the groupBy string key
2018-09-18 12:36:46 -05:00
Matt Jaffee
54ce537327
copy non roaring-import code from Todds's row-iterate PR
...
tests passing
2018-09-17 16:01:51 -05:00
Travis Turner
319456bbd7
implements Not() query
2018-09-11 15:29:43 -05:00
Travis Turner
9b4c67ee60
rename notnull to exists
2018-09-11 15:15:37 -05:00
Travis Turner
d57dae3749
implement NotNull field with index option trackNotNull
2018-09-11 15:13:55 -05:00
Ben Johnson
f4c9c0fed3
Maintain available shards set.
...
This commit removes the previous `MaxShard` tracking and replaces
it with an `Available Shards` set tracking. This allows sparse shard
tracking without implicitly tracking all shards in between.
2018-08-22 07:57:58 -06:00
Cody Soyland
f9625ef4fa
Fix linter issues: unparam
2018-07-17 12:05:07 -05:00
Cody Soyland
34e3d21b34
Fix linter issue: goimports
2018-07-16 16:31:46 -05:00
Cody Soyland
7728bdae71
Regenerate proto files
2018-07-09 12:53:33 -05:00
Travis Turner
5dd7a9556a
rename slice to shard
2018-06-28 14:07:07 -05:00
Ben Johnson
060254e0d6
Key-to-ID Translation
...
This commit adds id-to-key translation to make it easier for users
to provide non-integer identifiers for rows & columns.
2018-06-15 16:45:05 -06:00
Todd Gruben
aa21890503
moved to internal/test
2018-06-14 10:02:36 -05:00
Travis Turner
cb7487e34d
change all instances of internal Frame to Field
2018-06-05 23:24:24 -05:00
Travis Turner
636bf252ad
rename internal Frame to Field
2018-06-05 23:13:49 -05:00
Travis Turner
4254eb1d11
rename internal FrameMeta to FieldOptions
2018-06-05 23:10:59 -05:00
Travis Turner
50f8ea3921
remove CreateField and DeleteField from API
2018-06-05 13:58:28 -05:00
Travis Turner
2111a3d521
more Field removal/rename
2018-06-05 11:13:51 -05:00
Travis Turner
a6ae39d0b0
remove cases of Field from frame.go
2018-06-04 17:33:55 -05:00
