Commit graph

110 commits

Author SHA1 Message Date
Cody Soyland
3c48efb5b5
Merge pull request #1246 from codysoyland/391-log-startup
Log time/version to startup log (Fixes #391)
2018-05-04 12:48:15 -05:00
Cody Soyland
85f90ac8fc Log time/version to startup log (Fixes #391) 2018-05-03 16:11:43 -05:00
Cody Soyland
18d7664fc4 Rename ID file to ".id" for consistency with existing data files. 2018-05-02 15:04:12 -05:00
Matthew Jaffee
f9ff20689a
remove holder.Peek, combine with HasData, move server logic
Server initializing happens more in NewServer than Open now - expecting to
continue this trend. goal was to remove remoteClient from Server (since it has a
defaultClient) as well, but we'll have to refactor the client usage in fragment
and frame first.
2018-04-24 08:44:58 -05:00
Matthew Jaffee
28acc29a10
refactoring pilosa/server
trying to separate internal an external concerns in pilosa.Server - it should
handle Cluster, Holder, etc. while pilosa/server handles things with external
deps - e.g. Logger, Stats, Handler, etc. Using functional options in
pilosa.Server now.
2018-04-23 13:35:39 -05:00
Travis Turner
e7151eb2a8
Remove Index.TimeQuantum 2018-04-18 08:17:26 -05:00
Matthew Jaffee
04f5d5875c
api docs, rename funcs, refactor usage of internal
All exported funcs in api.go are now documented

Several poorly named methods of API and Cluster were renamed. Particularly, the
word Fragment was often changed to Slice in cases where it was really a slice
being specified and not a fragment.

several methods which received or returned internal data structures have been
refactored to be more opaque.

Deprecation logging was added to input definition methods.
2018-04-12 11:28:35 -05:00
Travis Turner
1764d5a9bf
Merge pull request #1180 from travisturner/remove-rowcol-labels
Remove rowcol labels
2018-04-03 22:37:59 -05:00
Travis Turner
9a2aeac6f8
Clean up logger; make it honor --log-path flag.
Add functional options to NewGossipMemberSet.
2018-03-27 08:40:04 -05:00
Travis Turner
b2b0fd081a
Remove ColumnLabel support 2018-03-26 15:35:56 -05:00
Cody Soyland
f9efa6c579 Use type func(string) AttrStore in place of interface AttrStoreGenerator for simplicity 2018-03-23 13:57:29 -05:00
Travis Turner
b66bedd1ef
put BoltDB behind AttrStore interface 2018-03-19 11:30:41 -05:00
Travis Turner
216ba7a41e
Use NodeID instead of URI for node identification 2018-02-02 15:58:46 -06:00
Travis Turner
12ee4f86d5
Merge pull request #1058 from travisturner/cluster-resize
Merge master into cluster-resize
2018-01-17 13:13:18 -06:00
Travis Turner
c0fab2bcee
Merge branch 'master' into cluster-resize 2018-01-17 12:55:12 -06:00
Travis Turner
3fc2f27710
add some statsd calls to HolderSyncer 2018-01-11 14:57:45 -06:00
Matthew Jaffee
664fb7cad0
convert some locks to rlocks 2018-01-09 13:55:29 -06:00
Travis Turner
e57c125c08
getting some minor fixes out of my stash 2018-01-04 10:45:04 -06:00
Travis Turner
6b3f4d1a64
Merge branch 'master' into cluster-resize
Refactored LocalID/ClusterID for use with Topology and Coordinator.
2017-12-18 15:39:50 -06:00
Yuce Tekol
1448171a2c
Adds local and cluster IDs 2017-12-15 18:12:28 +03:00
Travis Turner
2afbdba1c5
add lock protection around gossip.memberlist and holder.indexes 2017-12-13 08:54:11 -06:00
Travis Turner
0342da92bb
WIP: add tests for cluster resize
This commit adds support for allocating a gossip transport
and a server listener prior to opening server (and cluster).
Doing that allows tests to use a dynamically allocated port
by supplying bind port: 0.
2017-12-12 16:27:47 -06:00
Todd Gruben
c14bc29041 added logging for node membership 2017-12-07 11:17:37 -06:00
Travis Turner
c9886b049b
Merge branch 'master' into cluster-resize working branch. 2017-12-04 22:18:57 -06:00
Travis Turner
59cdd5dde9
Add HolderCleaner and view.DeleteFragment to support post-resize cleanups
Add tests for view.DeleteFragment and HolderCleaner
2017-12-04 18:03:22 -06:00
Todd Gruben
f051f7ccea refactored httpclient handling 2017-12-01 16:00:12 -06:00
Travis Turner
bd511dae80
ensure that holder opens before node is deemed ready 2017-11-27 11:06:03 -06:00
Travis Turner
453bbc996c
adjust Holder.Peek() and add tests for it 2017-11-10 10:38:49 -06:00
Travis Turner
9d87019762
WIP: don't block joining nodes while coordinator loads data.
Implements a Holder.Peek() function, and breaks out
Cluster.ListenForJoins() into a separate method that can be started
after the Holder finishes loading data.

TODO:
- [ ] test Holder.Peek()
2017-11-10 09:14:13 -06:00
Travis Turner
e641aa1d8a
Merge branch 'master' into 'cluster-resize' 2017-11-07 15:00:11 -06:00
Michael Baird
17da0443d3
Merge pull request #895 from raskle/diagnostics
Diagnostics
2017-11-06 11:30:38 -06:00
Travis Turner
73b9d9fd85
Add Cluster resize tests.
Consolidate schema creation into Holder.ApplySchema.
Add view names to proto schema.
2017-11-03 17:22:39 -05:00
Travis Turner
ed1b4fcc2e
Copy fragment data from source nodes in resize instruction. 2017-10-30 13:01:57 -05:00
Travis Turner
2bd0677df9
Remove MaxSlice polling.
Add Schema to proto.
Update MaxSlices in proto to include both standard and inverse.
Update LocalStatus (shared in gossip) to include MaxSlices and Schema.
Encode InputDefinitions with Index.

TODO:
- make sure InputDefinitions are considered in LocalStatus merge.
- decide what to do about `/slices/max` endpoint. client.backup is using
  it.
2017-10-26 23:48:40 -05:00
Travis Turner
a8871ada6a
Convert Host to URI.
Fix all compile errors.
2017-10-25 11:52:55 -05:00
Travis
f1e3ac90d4
Determine cluster membership via gossip.
Handle resize cluster events.
Add Toplogy support.
Refactor FrameOptions.
Add tests.
2017-10-25 00:27:30 -05:00
Michael Baird
cf543c9641 Add some new Diagnostics metrics 2017-10-18 10:16:30 -05:00
Yuce Tekol
66650ec1f7
NewExecutor doesn't return an error; renamed NewClient to NewInternalHTTPClient 2017-10-18 17:38:20 +03:00
Yuce Tekol
2c5a8d9125
Fixed Merge branch 'master' into tls-support-URI
# Conflicts:
#	cmd/server_test.go
2017-10-12 16:03:32 +03:00
Yuce Tekol
e223ec3f9a
Rename Host -> URI 2017-10-12 15:49:34 +03:00
Charlie Andrews
b6509a3ad7 Add RecalculateCaches to every level in hierarchy
This to decouple the implementation of recalculating caches from the
structure of the hierarchy: holder > index > frame > view > fragment.
See [Law of Demeter](https://en.wikipedia.org/wiki/Law_of_Demeter).
2017-10-11 09:36:32 -05:00
Charlie Andrews
9954bdd340 Add /recalculatecaches endpoint for triggering the recalculating of caches on demand 2017-10-09 17:07:39 -05:00
Yuce Tekol
3501732b19
https with signed certificates work 2017-10-08 21:11:19 +03:00
Yuce Tekol
1bedfd6585
use URI instead of host 2017-10-04 08:20:00 +03:00
Matthew Jaffee
ce7283ae1b
convert to RWMutex in index, holder, view, and frame
use RLock and RUnlock in mapperLocal hotpath
2017-09-25 15:16:40 -05:00
Michael Baird
2dfa689d71 Fragment.Close now returns an error.
This required changing the Holder test utility Reopen, since in those cases we needed to close the file before making permission changes that Close() was failing silently on.
2017-08-22 14:52:07 -05:00
Cody Soyland
bd4e828517 Use untyped constant to allow building on FreeBSD/Dragonfly 2017-07-27 14:19:19 -05:00
Cody Soyland
ed6e063102 Attempt to set hard open file limit, improve error messages, and add documentation about open file limits. 2017-07-26 17:08:51 -05:00
Cody Soyland
0df72e3d33 Attempt to set open file limit during Pilosa startup. Fixes #722. 2017-07-25 16:51:03 -05:00
Michael Baird
ee159b455d Merge remote-tracking branch 'origin/master' into metrics
Conflicts:
	.gitignore
	cluster.go
	frame.go
	glide.lock
	index.go
2017-05-01 10:41:04 -05:00