Travis Turner
12ee4f86d5
Merge pull request #1058 from travisturner/cluster-resize
...
Merge master into cluster-resize
2018-01-17 13:13:18 -06:00
Travis Turner
c0fab2bcee
Merge branch 'master' into cluster-resize
2018-01-17 12:55:12 -06:00
Travis Turner
3fc2f27710
add some statsd calls to HolderSyncer
2018-01-11 14:57:45 -06:00
Matthew Jaffee
664fb7cad0
convert some locks to rlocks
2018-01-09 13:55:29 -06:00
Travis Turner
e57c125c08
getting some minor fixes out of my stash
2018-01-04 10:45:04 -06:00
Travis Turner
6b3f4d1a64
Merge branch 'master' into cluster-resize
...
Refactored LocalID/ClusterID for use with Topology and Coordinator.
2017-12-18 15:39:50 -06:00
Yuce Tekol
1448171a2c
Adds local and cluster IDs
2017-12-15 18:12:28 +03:00
Travis Turner
2afbdba1c5
add lock protection around gossip.memberlist and holder.indexes
2017-12-13 08:54:11 -06:00
Travis Turner
0342da92bb
WIP: add tests for cluster resize
...
This commit adds support for allocating a gossip transport
and a server listener prior to opening server (and cluster).
Doing that allows tests to use a dynamically allocated port
by supplying bind port: 0.
2017-12-12 16:27:47 -06:00
Todd Gruben
c14bc29041
added logging for node membership
2017-12-07 11:17:37 -06:00
Travis Turner
c9886b049b
Merge branch 'master' into cluster-resize working branch.
2017-12-04 22:18:57 -06:00
Travis Turner
59cdd5dde9
Add HolderCleaner and view.DeleteFragment to support post-resize cleanups
...
Add tests for view.DeleteFragment and HolderCleaner
2017-12-04 18:03:22 -06:00
Todd Gruben
f051f7ccea
refactored httpclient handling
2017-12-01 16:00:12 -06:00
Travis Turner
bd511dae80
ensure that holder opens before node is deemed ready
2017-11-27 11:06:03 -06:00
Travis Turner
453bbc996c
adjust Holder.Peek() and add tests for it
2017-11-10 10:38:49 -06:00
Travis Turner
9d87019762
WIP: don't block joining nodes while coordinator loads data.
...
Implements a Holder.Peek() function, and breaks out
Cluster.ListenForJoins() into a separate method that can be started
after the Holder finishes loading data.
TODO:
- [ ] test Holder.Peek()
2017-11-10 09:14:13 -06:00
Travis Turner
e641aa1d8a
Merge branch 'master' into 'cluster-resize'
2017-11-07 15:00:11 -06:00
Michael Baird
17da0443d3
Merge pull request #895 from raskle/diagnostics
...
Diagnostics
2017-11-06 11:30:38 -06:00
Travis Turner
73b9d9fd85
Add Cluster resize tests.
...
Consolidate schema creation into Holder.ApplySchema.
Add view names to proto schema.
2017-11-03 17:22:39 -05:00
Travis Turner
ed1b4fcc2e
Copy fragment data from source nodes in resize instruction.
2017-10-30 13:01:57 -05:00
Travis Turner
2bd0677df9
Remove MaxSlice polling.
...
Add Schema to proto.
Update MaxSlices in proto to include both standard and inverse.
Update LocalStatus (shared in gossip) to include MaxSlices and Schema.
Encode InputDefinitions with Index.
TODO:
- make sure InputDefinitions are considered in LocalStatus merge.
- decide what to do about `/slices/max` endpoint. client.backup is using
it.
2017-10-26 23:48:40 -05:00
Travis Turner
a8871ada6a
Convert Host to URI.
...
Fix all compile errors.
2017-10-25 11:52:55 -05:00
Travis
f1e3ac90d4
Determine cluster membership via gossip.
...
Handle resize cluster events.
Add Toplogy support.
Refactor FrameOptions.
Add tests.
2017-10-25 00:27:30 -05:00
Michael Baird
cf543c9641
Add some new Diagnostics metrics
2017-10-18 10:16:30 -05:00
Yuce Tekol
66650ec1f7
NewExecutor doesn't return an error; renamed NewClient to NewInternalHTTPClient
2017-10-18 17:38:20 +03:00
Yuce Tekol
2c5a8d9125
Fixed Merge branch 'master' into tls-support-URI
...
# Conflicts:
# cmd/server_test.go
2017-10-12 16:03:32 +03:00
Yuce Tekol
e223ec3f9a
Rename Host -> URI
2017-10-12 15:49:34 +03:00
Charlie Andrews
b6509a3ad7
Add RecalculateCaches to every level in hierarchy
...
This to decouple the implementation of recalculating caches from the
structure of the hierarchy: holder > index > frame > view > fragment.
See [Law of Demeter](https://en.wikipedia.org/wiki/Law_of_Demeter ).
2017-10-11 09:36:32 -05:00
Charlie Andrews
9954bdd340
Add /recalculatecaches endpoint for triggering the recalculating of caches on demand
2017-10-09 17:07:39 -05:00
Yuce Tekol
3501732b19
https with signed certificates work
2017-10-08 21:11:19 +03:00
Yuce Tekol
1bedfd6585
use URI instead of host
2017-10-04 08:20:00 +03:00
Matthew Jaffee
ce7283ae1b
convert to RWMutex in index, holder, view, and frame
...
use RLock and RUnlock in mapperLocal hotpath
2017-09-25 15:16:40 -05:00
Michael Baird
2dfa689d71
Fragment.Close now returns an error.
...
This required changing the Holder test utility Reopen, since in those cases we needed to close the file before making permission changes that Close() was failing silently on.
2017-08-22 14:52:07 -05:00
Cody Soyland
bd4e828517
Use untyped constant to allow building on FreeBSD/Dragonfly
2017-07-27 14:19:19 -05:00
Cody Soyland
ed6e063102
Attempt to set hard open file limit, improve error messages, and add documentation about open file limits.
2017-07-26 17:08:51 -05:00
Cody Soyland
0df72e3d33
Attempt to set open file limit during Pilosa startup. Fixes #722 .
2017-07-25 16:51:03 -05:00
Michael Baird
ee159b455d
Merge remote-tracking branch 'origin/master' into metrics
...
Conflicts:
.gitignore
cluster.go
frame.go
glide.lock
index.go
2017-05-01 10:41:04 -05:00
Cody Soyland
3996b56b88
Apply Apache License 2.0
2017-04-28 14:22:03 -05:00
Travis
7246e1e00d
Broadcast CreateSliceMessage when a new max slice is created
2017-04-27 11:44:13 -05:00
Linh Vo
e67c9c051c
move statsd count to handler
2017-04-27 11:29:33 -05:00
Linh Vo
d18ee46d76
index, frame statsD and tests
2017-04-25 14:32:11 -05:00
Michael Baird
3512dd4549
missing comments
2017-04-25 14:15:02 -05:00
Linh Vo
beb280624d
create/delete index/frame tag
2017-04-25 11:08:28 -05:00
Michael Baird
a543ba21bb
fixed DB to index conflicts after merge
2017-04-24 21:59:39 -05:00
Travis
1343979308
Fixes up a few overlooked d := Index()
2017-04-24 11:17:30 -05:00
Travis
2ad322c2c7
Rename DB to Index
...
Rename `db.go` to `index.go` and `db_test.go` to `index_test.go`
2017-04-23 21:49:27 -05:00
Travis
2cacff8e09
Rename Index to Holder
...
Rename `index.go` to `holder.go` and `index_test.go` to `holder_test.go`
2017-04-23 15:59:20 -05:00