Commit graph

3762 commits

Author SHA1 Message Date
Michael Baird
e864a45d57 cleaned up the comments and code for the cache threshold. Also made the max size the set value of the cache rather than the calculated index. This ensures the user will not receive less cached values than they expect 2017-04-19 10:26:47 -05:00
Travis
d99edc2eef remove errant debugging line 2017-04-19 10:24:41 -05:00
Travis
cebca697b1 fixing tests that were affected by the messenger/view merge 2017-04-19 10:24:41 -05:00
Travis
13e08ac3a5 add tests for HTTPNodeSet 2017-04-19 10:24:00 -05:00
Travis
3abfea140b placeholder for localNode in HTTPNodeSet 2017-04-19 10:24:00 -05:00
Michael Baird
ce1e8e2e75 changed the frame cache name 2017-04-19 10:24:00 -05:00
Michael Baird
9a1a631dd4 test storing frame cache size 2017-04-19 10:22:44 -05:00
Michael Baird
8e2592e706 store cache size in Frame metadata 2017-04-19 10:22:44 -05:00
Travis
74b81eeac1 adjustments to support the new Config structure 2017-04-19 10:21:19 -05:00
Travis
8fa45649b6 WIP: Added support for NodeState.
Modified the gossip implementation to optionally send messages directly (instead of over gossip).
Added support for local and remote NodeState, as well as function to merge remote into local state.
Refactored Protobuf models to include `DBMeta` and `FrameMeta` as well as support for NodeState.
2017-04-19 10:19:17 -05:00
Travis
2b35df879c WIP: first pass at sending CreateDB() through Messenger 2017-04-19 10:15:57 -05:00
Travis
7c2f6a9bae adds a basic gossip implementation using hashicorp/memberlist
Changes Gossiper to NodeSet.
Adds StaticNodeSet (for testing) and GossipNodeSet (for memberlist) implementations.
Changes NodeSet interface to return a pilosa-specific generic instead of `NodeSet interface`.
Removes NumMembers from interface (which is specific to memberlist).

Implements a Messenger interface with which to send inter-node messages via NodeSet.
The Pilosa implementation occurs in the GossipNodeSet.

Implements the Messenger as an object on Server, Handler, and Index.

Uses HealthStatus constants.
Removes commented-out code.

for gossip, make sure to bind to both host and port, and advertise those as well

adjust messenger to work with the db schema logic

add dependencies: hashicorp/memberlist, golang.org/x/sync
add dependency: golang.org/x/net

Uses `errgroup` to handle errors from broadcast messages.
Marshals message one time instead of once for every node.
Adds error handling for some errors that were being swallowed.
2017-04-19 10:13:38 -05:00
Michael Baird
9321637d18 trim the ranked cache set on the 1st recalculate call 2017-04-19 10:06:11 -05:00
Michael Baird
4e7c2af572 fixed test to use ranked frame type 2017-04-19 10:06:11 -05:00
Michael Baird
591c35c95f set the cache size on frame creation 2017-04-19 10:06:11 -05:00
Michael Baird
3b71ed1b2f make the fragment cache ThresholdIndex a function at 90% of ThresholdLength 2017-04-19 10:06:10 -05:00
Michael Baird
8ceaef1eaa fragment cache size is set on frame creation with a default value of 50,000 2017-04-19 10:06:10 -05:00
Michael Baird
db33df5598 Merge pull request #460 from jaffee/godocify
Godocify
2017-04-19 08:31:17 -05:00
Travis Turner
65de0c7d8a Merge pull request #459 from travisturner/handler-mux
Handler mux
2017-04-18 16:44:19 -05:00
Alan Bernstein
cbf0fddc54 Remove statik from glide.lock 2017-04-18 15:36:12 -05:00
Matt Jaffee
e6309d45e1 make sure exported functions are godoc'd 2017-04-18 15:10:59 -05:00
Travis Turner
45069f6a6b Merge pull request #438 from travisturner/contributing
basic outline for CONTRIBUTING.md
2017-04-18 14:32:14 -05:00
Travis
95a546e138 adjust tests and client to comply with the new HTTP endpoints 2017-04-18 14:19:36 -05:00
Travis
63df926968 put the handler router endpoints in alphabetical order 2017-04-18 14:12:59 -05:00
Cody Soyland
a6c7a0f894 WIP handler changes 2017-04-18 14:12:59 -05:00
Cody Soyland
4397e13a82 Use gorilla mux instead of big switch statement 2017-04-18 14:12:59 -05:00
Matt Jaffee
0a324d14a5 add fix all package level docs 2017-04-18 14:11:42 -05:00
Matt Jaffee
89219643a7 add top level doc.go file to pilosa package 2017-04-18 13:55:48 -05:00
Matthew Jaffee
c10ef33042 Merge pull request #445 from jaffee/377-signed-attrs
add signed int support
2017-04-18 13:01:18 -05:00
Matt Jaffee
6f443f447a add signed int support
this affects the scanner/parser and makes it produce signed ints rather than
uints, and so it affects all code that is expecting unsighed ints to come out of
the parser.
2017-04-18 12:50:26 -05:00
Ben Johnson
47a68bc3bd Merge pull request #455 from benbjohnson/merge-bitmap-profile-call
Consolidate Bitmap() & Profile() calls.
2017-04-18 09:14:56 -06:00
Ben Johnson
11882b4577 Merge pull request #449 from benbjohnson/remove-ranked-suffix
Add cacheType to frame options.
2017-04-18 09:14:40 -06:00
Ben Johnson
d32edb5329 Add cacheType to frame options.
Previously the cache type (`lru` or `ranked`) was determined by
checking the ending suffix of the frame. If it ended with a `.n`
then it was ranked. Otherwise it was an LRU.

This commit changes frames so that a `cacheType` option can be
passed in during creation to set either `lru` or `ranked`.
2017-04-18 08:24:58 -06:00
Linh Vo
0e92b5af85 Merge pull request #456 from linhvo/rename-file
correct file's name
2017-04-17 22:16:17 -05:00
Travis Turner
acb12881af Merge pull request #452 from travisturner/proto-public-private
split `internal.proto` into `public.proto` and `private.proto`.
2017-04-17 18:03:51 -05:00
Linh Vo
b33c5a20fd correct file's name 2017-04-17 15:50:22 -05:00
Ben Johnson
9cbc786376 Consolidate Bitmap() & Profile() calls.
This commit changes the executor to select a bitmap from the
standard view or the inverse view based on whether the row label
or column label is specified.
2017-04-17 13:48:56 -06:00
Travis
4c16101a5a split internal.proto into public.proto and private.proto.
this allows us to share `public.proto` with the client libraries without needing to share
those that we only use internally.
2017-04-17 10:27:36 -05:00
Travis
9c1603318c adjustments to CONTRIBUTING.md instructions 2017-04-17 08:01:49 -05:00
Ben Johnson
a302521968 Merge pull request #447 from benbjohnson/inverse-opt-in
Opt-in to inverse storage.
2017-04-13 10:04:25 -06:00
Linh Vo
8f5a00ffe9 Merge pull request #414 from linhvo/364-argument-validation
364 argument validation
2017-04-12 13:20:13 -05:00
Linh Vo
172f7490f6 fixed conflicts 2017-04-12 12:31:56 -05:00
Ben Johnson
306cc0b64e Opt-in to inverse storage. 2017-04-12 08:34:31 -06:00
Ben Johnson
32f82ef8e1 Merge pull request #439 from benbjohnson/default-frame-time-quantum
Default time quantum on new frames.
2017-04-10 11:37:35 -06:00
Ben Johnson
6487da01a6 Default time quantum on new frames.
Sets the frame time quantum to the quantum on the parent database
when creating a new frame.
2017-04-07 16:28:03 -06:00
Travis
5259d5ae70 basic outline for CONTRIBUTING.md 2017-04-07 16:28:39 -05:00
Linh Vo
9abdb29269 remove duplicate code, move ValidateName out of validateOptions 2017-04-06 23:28:16 -05:00
Linh Vo
b2db339741 remove comment code 2017-04-06 16:20:08 -05:00
Linh Vo
37ffcd4ed9 refactor validateOptions 2017-04-06 16:03:35 -05:00
Ben Johnson
6ce4621eba Merge pull request #415 from benbjohnson/view-refactor
Refactor higher level view interface.
2017-04-05 17:01:01 -06:00