Jason E. Aten
9b635068d9
cleanup
2021-01-18 20:16:49 +00:00
Jason E. Aten
ad1c3ff3fb
go mod tidy
2021-01-18 19:18:08 +00:00
Jason E. Aten
e58b464b29
add port.GetListeners
2021-01-18 18:42:21 +00:00
Todd Gruben
766e3b90bc
wip
2021-01-18 10:59:01 -06:00
Todd Gruben
de7d69234e
initial listner
2021-01-18 10:34:18 -06:00
Travis Turner
d6d51705fa
Merge pull request #1334 from travisturner/disco-merge
...
Disco merge
2021-01-15 18:42:13 -06:00
Travis
1d55e671a2
go mod tidy and linter
...
fix race
cleanup
2021-01-15 17:48:44 -06:00
Travis
9855f4d0a0
Merge branch 'travis-test-ci' into disco-try
2021-01-15 14:31:19 -06:00
Jason E. Aten
8909517dfd
cluster_internal_tests use getport
2021-01-15 11:47:37 -06:00
Jason E. Aten
530fd4e768
GlobalPortMapper avoids many races in port allocation for cluster setup
2021-01-15 11:47:37 -06:00
Travis
4355bdd8f0
temporarily have cluster implement Noder
2021-01-15 11:47:37 -06:00
Travis
10380a1da1
Implement snap := ClusterSnapshot()
...
Below is the list of instance of `ClusterSnapshot()` in the latest
`with-etcd` code. Some of these may not yet exist in the `disco` branch,
but this commit is implementing any that currently apply.
==========================
Done:
==========================
index.go
930: snap := NewClusterSnapshot(topo, topo.Hasher, topo.ReplicaN)
1072: snap := NewClusterSnapshot(topo, topo.Hasher, topo.ReplicaN)
cmd/pilosa-fsck/fsck.go
786: snap := pilosa.NewClusterSnapshot(cfg.topo, cfg.topo.Hasher, cfg.topo.ReplicaN)
boltdb/translate.go
558: snap := pilosa.NewClusterSnapshot(topo, topo.Hasher, topo.ReplicaN)
1264: snap := pilosa.NewClusterSnapshot(topo, topo.Hasher, topo.ReplicaN)
fragment.go
3448: snap := NewClusterSnapshot(s.Cluster.noder, s.Cluster.Hasher, s.Cluster.ReplicaN)
3568: snap := NewClusterSnapshot(s.Cluster.noder, s.Cluster.Hasher, s.Cluster.ReplicaN)
3620: snap := NewClusterSnapshot(s.Cluster.noder, s.Cluster.Hasher, s.Cluster.ReplicaN)
==========================
Remaining:
==========================
cluster.go
371: snap := NewClusterSnapshot(NewLocalNoder(nodes), c.Hasher, c.ReplicaN)
474: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
639: fSnap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
640: toSnap := NewClusterSnapshot(to.noder, c.Hasher, to.ReplicaN)
703: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
1475: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
1502: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
1941: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
1986: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
2049: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
2126: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
api.go
475: snap := NewClusterSnapshot(api.cluster.noder, api.cluster.Hasher, api.cluster.ReplicaN)
604: snap := NewClusterSnapshot(api.cluster.noder, api.cluster.Hasher, api.cluster.ReplicaN)
690: snap := NewClusterSnapshot(api.cluster.noder, api.cluster.Hasher, api.cluster.ReplicaN)
1684: snap := NewClusterSnapshot(api.cluster.noder, api.cluster.Hasher, api.cluster.ReplicaN)
1946: snap := NewClusterSnapshot(api.cluster.noder, api.cluster.Hasher, api.cluster.ReplicaN)
executor.go
3781: snap := NewClusterSnapshot(e.Cluster.noder, e.Cluster.Hasher, e.Cluster.ReplicaN)
4157: snap := NewClusterSnapshot(e.Cluster.noder, e.Cluster.Hasher, e.Cluster.ReplicaN)
4200: snap := NewClusterSnapshot(e.Cluster.noder, e.Cluster.Hasher, e.Cluster.ReplicaN)
4243: snap := NewClusterSnapshot(e.Cluster.noder, e.Cluster.Hasher, e.Cluster.ReplicaN)
4517: snap := NewClusterSnapshot(NewLocalNoder(e.Cluster.Nodes()), e.Cluster.Hasher, e.Cluster.ReplicaN)
holder.go
1465: snap := NewClusterSnapshot(s.Cluster.noder, s.Cluster.Hasher, s.Cluster.ReplicaN)
1668: snap := NewClusterSnapshot(s.Cluster.noder, s.Cluster.Hasher, s.Cluster.ReplicaN)
1889: snap := NewClusterSnapshot(s.Cluster.noder, s.Cluster.Hasher, s.Cluster.ReplicaN)
1963: snap := NewClusterSnapshot(c.Cluster.noder, c.Cluster.Hasher, c.Cluster.ReplicaN)
2021-01-15 11:47:37 -06:00
Travis
7875fb8e5a
remove pilosa.DefaultPartitionN
2021-01-15 11:47:37 -06:00
Jason E. Aten
dd7f0f3c88
use bbolt v1.3.5 that has fixed the checkptr bugs
2021-01-15 11:47:37 -06:00
Travis
f633fcd4ae
remove pilosa.URI
2021-01-15 11:47:36 -06:00
Travis
ff2d235702
change all references to use subpackages: topology, net
2021-01-15 11:47:36 -06:00
Travis
0add3fc7c6
fix linter and go.mod issues
2021-01-15 11:47:36 -06:00
Travis
85560323dc
add licence headers
2021-01-15 11:47:36 -06:00
Travis
b251d4c6c1
change bbolt version back to 1.3.3
2021-01-15 11:47:36 -06:00
Travis
9d8a6ad28d
add subpackages: topology, net
2021-01-15 11:47:35 -06:00
Kuba Podgórski
ba7108dedb
Revert "Cleanup etcd dir"
...
This reverts commit 886ba15e88
2021-01-15 17:50:34 +01:00
Kuba Podgórski
886ba15e88
Cleanup etcd dir
2021-01-15 15:41:16 +01:00
Kuba Podgórski
a4f9aee28e
Set etcd log level to error
2021-01-15 14:11:48 +01:00
Kuba Podgórski
6cd8f6a970
Less TestMain_Set_Quick parallel tests
2021-01-15 13:24:41 +01:00
Kuba Podgórski
17b1eeb0d0
Increase timeout (30s) for cluster NORMAL state
2021-01-15 12:55:03 +01:00
Kuba Podgórski
64425736b0
Create disco dir outside pilosa
2021-01-15 12:30:57 +01:00
Travis
684b20edb3
disco open/close debugging
2021-01-14 23:02:58 -06:00
Kuba Podgórski
4afaaa5e25
remove zap
2021-01-14 20:59:17 +01:00
Kuba Podgórski
9a0facaaa3
set even more ports for Node Command
2021-01-14 20:20:23 +01:00
Kuba Podgórski
201e851511
set more ports for Node Command
2021-01-14 20:04:09 +01:00
Kuba Podgórski
33c4c77495
revert bind port to 0
2021-01-14 18:33:22 +01:00
Kuba Podgórski
36f17eee1d
global mutex on GetPorts
2021-01-14 18:04:16 +01:00
Kuba Podgórski
a100a38b4a
don't close disco on Server.Close
2021-01-14 17:47:06 +01:00
Kuba Podgórski
0e4a7a29fb
close disco before holder
2021-01-14 17:35:30 +01:00
Kuba Podgórski
2713be9329
check error as string
2021-01-14 17:12:52 +01:00
Kuba Podgórski
1f6ed4feca
bangbang theory
2021-01-14 16:25:44 +01:00
Antonio Navarro Perez
1a5ab4b155
Fix some more problems
...
Signed-off-by: Antonio Navarro Perez <antnavper@gmail.com>
2021-01-14 13:10:51 +01:00
Antonio Navarro Perez
052aadb3b0
Wrap some missing constructors using ports.
...
Signed-off-by: Antonio Navarro Perez <antnavper@gmail.com>
2021-01-14 10:48:46 +01:00
Travis
27614c42f7
Finish implementing port wrapper
2021-01-13 22:56:54 -06:00
Antonio Navarro Perez
d20b831084
Add port wrapper POC
...
Signed-off-by: Antonio Navarro Perez <antnavper@gmail.com>
2021-01-13 20:14:33 +01:00
Kuba Podgórski
61edff3eee
Apply closed channel fix
...
45619a5b7b
2021-01-13 15:37:13 +01:00
Kuba Podgórski
4afb0ecc51
Close TCP listeneer on port mapper
2021-01-13 13:53:27 +01:00
Travis
877af6dad9
replace a MustNewCluster with MustRunCluster
2021-01-12 23:30:10 -06:00
Travis
ef8d0759d5
add retry to pg test ServerTLS()
2021-01-12 23:04:49 -06:00
Travis
f2234929d8
add retry to MustRunCluster
2021-01-12 22:09:09 -06:00
Travis
bc13834343
disco/etcd work: fix lots of races, start all cluster nodes at once.
...
port mapper gives out ports from 63000-65000 for the tests
fix another race
http test uses port.MustGetPort
rbf: remove :0 port request
ocd happy
test fix for grpc listener address already in use
test/disco allocates BindGRPC port from the port mapper
dump stack on each GetPort
verify each port is usable right away
server/config.go has Config.Validate() now
panic if gossip port is 0. validate server.Config
fix another gossip port 0
builds
quiet, don't dump stack on each port alloc
builds
happy linter
even gossip fallback should not be zero but rather use the port mapper
2021-01-12 21:06:12 -06:00
Ben Johnson
fbf546f131
Merge pull request #1319 from molecula/pilosa-bench
2021-01-12 16:51:27 -07:00
Ben Johnson
b7973e2612
Add read benchmarks
2021-01-12 13:48:09 -07:00
Matthew Jaffee
701d6448cc
Merge pull request #1307 from jaffee/1292-panic-groupby-int-distinct-aggregate
...
Fix potential panic when grouping on int field with Distinct aggregate
2021-01-08 16:38:00 -06:00
Matt Jaffee
48552553dc
guard against NPE when setting precomputed data
...
If a precomputed call returns a nil Row result somehow, that could
cause a nil pointer exception when handling the result in
handlePreCall.
In this particular case, A Distinct call on a BSI field with a filter
which returned no results could return a SignedRow{} with nil *Rows
inside of it. This only manifested if there was data in a single shard
as otherwise the reduce logic created a SignedRow with empty *Row
objects rather than nil ones. Isn't that fun?
Extra fun: the reason the filter was returning no results was not
because it was actually empty, but because of another bug where
constructing the Distinct calls to compute the aggregate of a GroupBy
doesn't take into account that the group might include an integer
field which means that the call needs to be constructed
differently. That bug is not fixed in this commit, hence the tests are
still failing, but not panicking.
2021-01-08 15:03:49 -06:00
