Kuba Podgórski
2c4c722a1b
Merge pull request #1348 from travisturner/disco-storage-config
...
introduce storage.Config
2021-01-22 11:12:15 +01:00
Travis
19f91782e7
remove all instances of txsrc
2021-01-21 21:59:51 -06:00
Travis
13984353e4
remove instances of os.Getenv("PILOSA_TXSRC")
2021-01-21 21:18:46 -06:00
Nia Weiss
0d9179f10c
roaring: fix intersectionAnyRunBitmap when processing single-word runs
...
When a run started and ended within a single word, the entirety of the word would be checked.
This would cause small runs to be processed incorrectly, and caused Distinct-on-sets to select rows that did not match the specified filter.
2021-01-21 18:09:27 -05:00
nagamocha3000
16b5fbe40b
Merge branch 'master' into bnm-fix-1080
2021-01-21 17:37:08 +03:00
nagamocha3000
6cbcde3a82
Add more tests for GroupBy on Time fields
2021-01-21 16:20:46 +03:00
nagamocha3000
113bec2474
Remove unnecessary nil check
2021-01-21 15:48:52 +03:00
Travis
f292d6061a
replace pilosa.DefaultTxsrc with storage.DefaultBackend
2021-01-20 22:06:13 -06:00
Travis
08fae2be4c
introduce storage.Config
2021-01-20 22:05:38 -06:00
Alan Bernstein
b273f3ba60
Merge pull request #1327 from alanbernstein/sql-history
...
Include SQL string in query-history
2021-01-20 19:05:36 -06:00
Alan Bernstein
eaf3ef153e
Test SQL behavior
2021-01-20 15:58:55 -06:00
Alan Bernstein
bed03ba490
Update tests
2021-01-20 10:48:35 -06:00
Alan Bernstein
a0d6c253d1
Pass SQL query string from mapper to tracker
2021-01-20 10:48:35 -06:00
Cody Soyland
06241d1f84
Merge pull request #1258 from codysoyland/distinct-failure
...
Test to demonstrate failure running Distinct
2021-01-20 10:37:47 -06:00
Cody Soyland
0a325dcdb8
Merge branch 'master' into distinct-failure
2021-01-19 16:50:25 -06:00
seebs
38ded7963e
Merge pull request #1342 from seebs/aggregate
...
Handle aggregate functions better in sql/grpc/json
2021-01-19 16:28:32 -06:00
Seebs
932e84b681
handling aggregate types: add to protobuf, etc
...
We want to distinguish different *kinds* of GroupCounts, so we're
making the GroupCounts parent object track its type so we can keep that
correct.
Adding this to protobuf, etc, then creates some weird behaviors
because sometimes we expect []GroupCount, and sometimes we expect
*GroupCounts. This implies changes to test cases. Also, the
changes to test cases imply that some test cases are probably now
wrong; for instance, they're expecting a "sum" column, equal to zero,
when no sum was requested.
We try to make the encoder handle a []*GroupCount gotten from another
node without panicing, and avoid breaking the semantics of the existing
messages, renumbering messages or components, etc.
Since a previous version, the `.Groups` member has been privatized,
and the `.Get()` convenience accessor has been renamed `.Groups()`
and is now used consistently in a way that should reduce the risk
of nil pointers causing crashes. Also, NewGroupCounts is used in
a couple more places.
2021-01-19 16:23:15 -06:00
Cody Soyland
4ebf6f6ff7
Customize serialization of []GroupCount based on aggregate type/presence
2021-01-19 12:10:56 -06:00
Travis Turner
07d9cbe380
Merge pull request #1345 from travisturner/disco-config
...
port disco config to ctl/server
2021-01-19 10:50:17 -06:00
nagamocha3000
0437f5d28a
Handle case where row returned might be nil
2021-01-19 16:51:26 +03:00
Travis
f47800a920
add DisCo config to ctl/server
2021-01-18 23:47:35 -06:00
Ben Johnson
56c001d288
Merge pull request #1341 from molecula/bench-vars
...
Update benchmarks to use expvar URL list
2021-01-18 16:06:43 -07:00
nagamocha3000
d26c6b048e
Sort all rowIDs gathered before storing them
2021-01-19 02:00:50 +03:00
nagamocha3000
9b23dcdd0a
Gather rows for each fragment in a much smarter way
2021-01-19 01:44:54 +03:00
tgruben
ef05968e20
Merge pull request #1340 from jaten-molecula/noder_impl
...
Noder impl
2021-01-18 15:22:17 -06:00
Ben Johnson
01e6781abd
Update benchmarks to use expvar URL list
2021-01-18 13:43:53 -07:00
jaten-molecula
3928b6854b
Merge pull request #1338 from jaten-molecula/etcd-listner
...
Etcd listener
2021-01-18 14:40:32 -06:00
Jason E. Aten
b1a0e0ae8b
allow retry at the cluster level to work; remove retry for server/server.go Command.setupNetworking() that retries a single gossip node
2021-01-18 20:39:23 +00:00
Jason E. Aten
ed12f3585c
etcd/embed.go implemented Noder
2021-01-18 20:30:21 +00:00
Jason E. Aten
9b635068d9
cleanup
2021-01-18 20:16:49 +00:00
Jason E. Aten
ad1c3ff3fb
go mod tidy
2021-01-18 19:18:08 +00:00
Jason E. Aten
e58b464b29
add port.GetListeners
2021-01-18 18:42:21 +00:00
nagamocha3000
f51ff4dc85
Add tests for Rows() on time fields
2021-01-18 20:54:31 +03:00
Todd Gruben
766e3b90bc
wip
2021-01-18 10:59:01 -06:00
Todd Gruben
de7d69234e
initial listner
2021-01-18 10:34:18 -06:00
Travis Turner
d6d51705fa
Merge pull request #1334 from travisturner/disco-merge
...
Disco merge
2021-01-15 18:42:13 -06:00
Travis
1d55e671a2
go mod tidy and linter
...
fix race
cleanup
2021-01-15 17:48:44 -06:00
nagamocha3000
b77f9e8a43
Add timeFragments rowIterator
2021-01-15 23:36:54 +03:00
Travis
9855f4d0a0
Merge branch 'travis-test-ci' into disco-try
2021-01-15 14:31:19 -06:00
nagamocha3000
f91b4bc016
Add queries to test GroupBy Rows on time field
2021-01-15 22:58:18 +03:00
nagamocha3000
54d79d1e4d
Populate 'places_visited' field for 'users' index
2021-01-15 22:50:54 +03:00
nagamocha3000
4dc3e49a0d
Add test helper for inserting to time quantum fields
2021-01-15 22:42:37 +03:00
Jason E. Aten
8909517dfd
cluster_internal_tests use getport
2021-01-15 11:47:37 -06:00
Jason E. Aten
530fd4e768
GlobalPortMapper avoids many races in port allocation for cluster setup
2021-01-15 11:47:37 -06:00
Travis
4355bdd8f0
temporarily have cluster implement Noder
2021-01-15 11:47:37 -06:00
Travis
10380a1da1
Implement snap := ClusterSnapshot()
...
Below is the list of instance of `ClusterSnapshot()` in the latest
`with-etcd` code. Some of these may not yet exist in the `disco` branch,
but this commit is implementing any that currently apply.
==========================
Done:
==========================
index.go
930: snap := NewClusterSnapshot(topo, topo.Hasher, topo.ReplicaN)
1072: snap := NewClusterSnapshot(topo, topo.Hasher, topo.ReplicaN)
cmd/pilosa-fsck/fsck.go
786: snap := pilosa.NewClusterSnapshot(cfg.topo, cfg.topo.Hasher, cfg.topo.ReplicaN)
boltdb/translate.go
558: snap := pilosa.NewClusterSnapshot(topo, topo.Hasher, topo.ReplicaN)
1264: snap := pilosa.NewClusterSnapshot(topo, topo.Hasher, topo.ReplicaN)
fragment.go
3448: snap := NewClusterSnapshot(s.Cluster.noder, s.Cluster.Hasher, s.Cluster.ReplicaN)
3568: snap := NewClusterSnapshot(s.Cluster.noder, s.Cluster.Hasher, s.Cluster.ReplicaN)
3620: snap := NewClusterSnapshot(s.Cluster.noder, s.Cluster.Hasher, s.Cluster.ReplicaN)
==========================
Remaining:
==========================
cluster.go
371: snap := NewClusterSnapshot(NewLocalNoder(nodes), c.Hasher, c.ReplicaN)
474: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
639: fSnap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
640: toSnap := NewClusterSnapshot(to.noder, c.Hasher, to.ReplicaN)
703: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
1475: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
1502: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
1941: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
1986: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
2049: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
2126: snap := NewClusterSnapshot(c.noder, c.Hasher, c.ReplicaN)
api.go
475: snap := NewClusterSnapshot(api.cluster.noder, api.cluster.Hasher, api.cluster.ReplicaN)
604: snap := NewClusterSnapshot(api.cluster.noder, api.cluster.Hasher, api.cluster.ReplicaN)
690: snap := NewClusterSnapshot(api.cluster.noder, api.cluster.Hasher, api.cluster.ReplicaN)
1684: snap := NewClusterSnapshot(api.cluster.noder, api.cluster.Hasher, api.cluster.ReplicaN)
1946: snap := NewClusterSnapshot(api.cluster.noder, api.cluster.Hasher, api.cluster.ReplicaN)
executor.go
3781: snap := NewClusterSnapshot(e.Cluster.noder, e.Cluster.Hasher, e.Cluster.ReplicaN)
4157: snap := NewClusterSnapshot(e.Cluster.noder, e.Cluster.Hasher, e.Cluster.ReplicaN)
4200: snap := NewClusterSnapshot(e.Cluster.noder, e.Cluster.Hasher, e.Cluster.ReplicaN)
4243: snap := NewClusterSnapshot(e.Cluster.noder, e.Cluster.Hasher, e.Cluster.ReplicaN)
4517: snap := NewClusterSnapshot(NewLocalNoder(e.Cluster.Nodes()), e.Cluster.Hasher, e.Cluster.ReplicaN)
holder.go
1465: snap := NewClusterSnapshot(s.Cluster.noder, s.Cluster.Hasher, s.Cluster.ReplicaN)
1668: snap := NewClusterSnapshot(s.Cluster.noder, s.Cluster.Hasher, s.Cluster.ReplicaN)
1889: snap := NewClusterSnapshot(s.Cluster.noder, s.Cluster.Hasher, s.Cluster.ReplicaN)
1963: snap := NewClusterSnapshot(c.Cluster.noder, c.Cluster.Hasher, c.Cluster.ReplicaN)
2021-01-15 11:47:37 -06:00
Travis
7875fb8e5a
remove pilosa.DefaultPartitionN
2021-01-15 11:47:37 -06:00
Jason E. Aten
dd7f0f3c88
use bbolt v1.3.5 that has fixed the checkptr bugs
2021-01-15 11:47:37 -06:00
Travis
f633fcd4ae
remove pilosa.URI
2021-01-15 11:47:36 -06:00
Travis
ff2d235702
change all references to use subpackages: topology, net
2021-01-15 11:47:36 -06:00
