Travis Turner
efb9f97e61
Advertise address and listen on 0.0.0.0
...
This commit adds support for advertise address by using a new config
option `advertise`, or by defaulting its value to that
specified in `bind`.
Also adds support for listening on 0.0.0.0 by trying to determine
the preferred outbound IP to use for the advertise address.
2019-01-21 22:36:55 -06:00
Matt Jaffee
ff800131cb
ensure internal client closes all response bodies to avoid leaking connections/goroutines
2018-12-19 11:57:47 -06:00
Travis Turner
84fddbc67f
Replace the /fragment/data endpoint to support cluster resizing
2018-12-18 08:34:47 -06:00
Ben Johnson
8e49332b25
Add distributed tracing.
2018-11-21 15:08:33 -06:00
Yuce Tekol
12112e0aef
Merged with master; check for empty roaring data
2018-11-21 18:22:40 +03:00
Yuce Tekol
84c04900e1
Import roaring enpoint accepts a list of views
2018-11-12 18:43:59 +03:00
Yuce Tekol
27c222f02d
Refactored missing executeRequest bits; check resp is not nil
2018-11-08 17:02:07 +03:00
Yuce Tekol
f2394f6d93
lowercase error msg
2018-11-08 08:25:43 +03:00
Yuce Tekol
7b7e96bdee
Trivial
2018-11-07 18:47:15 +03:00
Yuce Tekol
8d5f76d4f4
Fixes #1697
2018-11-07 18:37:28 +03:00
Travis Turner
063caed8d1
forward imports to non-coordinator shards
2018-11-05 17:39:42 -06:00
Travis Turner
f02605a528
consolidate ImportOptions setup. use url.Values{}. fix comments.
2018-10-23 17:37:57 -05:00
Travis Turner
5fb6ef224c
add clear support for ImportRoaring
2018-10-23 17:37:57 -05:00
Travis Turner
a7a15c64a2
support clear imports to int fields. fix bug in fragment.sum
2018-10-23 17:37:57 -05:00
Travis Turner
caf8e06712
add clear functional option for imports
2018-10-23 17:37:57 -05:00
Matt Jaffee
f943c17e0b
ImportRoaring, add remote arg, fix data copy bug
...
also, handle err properly in client method instead of discarding.
2018-09-13 15:05:05 -05:00
Matt Jaffee
b412309447
rename standard roaring to "official" throughout
2018-09-13 13:38:18 -05:00
Matt Jaffee
fd655c998e
rename all instances of roaringbytes
...
function names now importRoaring and byte slice args are just called data. Also
renamed http endpoint from /importroaring to /import-roaring
2018-09-13 12:27:23 -05:00
tgruben
5589324865
Merge branch 'master' into roaring-import
2018-09-06 16:28:38 -05:00
Todd Gruben
93e5767325
cleanup #1622
2018-09-06 16:27:10 -05:00
Todd Gruben
1d99da1f28
added support for both pilosa and standard roaring uploads
2018-09-05 10:13:15 -05:00
Todd Gruben
cc80e0b0e4
initial support for bulk importing standard roaring files per shard
2018-09-05 10:13:15 -05:00
Yuce Tekol
7b872e00cb
Implements #1570
2018-09-05 17:10:56 +03:00
Travis Turner
f1a460aca7
adds view parameter to sync logic for syncing time fields
2018-08-16 11:27:08 -05:00
Travis Turner
bf4e2e598b
add support for column keys when importing to int fields
2018-08-15 16:00:31 -05:00
Travis Turner
862dabe27d
address review comments
2018-08-14 14:37:51 -05:00
Travis Turner
fd96d3a02e
This commit ensures that keyed imports are sent to the coordinator
...
node (as opposed to sending to shard0, which may or may not be the
coordinator). It adds a `Nodes()` method to the `InternalClient`
which is used by the importer to determine which node is the
coordinator.
2018-08-14 12:34:17 -05:00
Ben Johnson
a31a08c330
Support keys on import CLI.
2018-08-14 09:32:39 -05:00
Cody Soyland
e460a58bfa
Unexport http.InternalClient.HTTPClient
2018-07-05 23:11:56 -05:00
Matt Jaffee
d032c8941f
Merge branch 'develop' into dead-code-removal
2018-07-05 18:02:39 -05:00
Matt Jaffee
21cf6b6e57
remove URI getters since the fields were exported for serialization
2018-07-05 17:59:18 -05:00
Matt Jaffee
db2a53223d
remove internal references from api and http/*
2018-07-05 16:02:18 -05:00
Cody Soyland
da4cd84820
Remove some dead code
2018-07-05 15:31:07 -05:00
Matt Jaffee
e76a90e69b
change Query and QueryNode to use pilosa.* Query structs
2018-07-05 15:02:33 -05:00
Matt Jaffee
2cec75e399
add proto encoding subpackage and use for send and receive message
2018-07-05 12:00:42 -05:00
Travis Turner
9fd5ead7de
remove unused importValueNode() method
2018-07-02 10:41:54 -05:00
Travis Turner
2898a422bf
consolidate import and import-value endpoints
2018-07-02 10:41:54 -05:00
Travis Turner
cba91be126
move internal http endpoints under /internal
2018-07-02 08:48:23 -05:00
Travis Turner
7dd1f50a75
consolidate http errors into a shared response type
2018-07-01 19:54:09 -05:00
Matt Jaffee
ea77db895a
fix syncholder test and a few bugs
...
The http internal client's FragmentBlocks and Blockdata methods were being used
incorrectly, and incorrect respectively. One was not being passed a node URI by
monitorAntiEntropy, and the other was always using the defaultURI regardless of
what was passed to it. Antientropy was doubling not working because of this. I
think this crept in pretty recently, so hasn't actually affected anyone.
I exposed a SyncData method on Server so that we can invoke the anti entropy
task manually instead of trying to set up the interval so that it will run and
then sleeping and waiting for it to run. Now that this test works the way it
does, the other anti entropy test is obsolete, and I deleted it.
2018-06-29 14:48:13 -05:00
Travis Turner
5dd7a9556a
rename slice to shard
2018-06-28 14:07:07 -05:00
Travis Turner
50794bf63b
move fieldOptions unmarshal to the handler
...
validate fieldOptions in http package
2018-06-25 15:14:22 -05:00
Todd Gruben
aac2397949
enforced Accept for json response endpoints
2018-06-20 13:13:46 -05:00
Cody Soyland
daffa3b125
Rename InternalHTTPClient -> InternalClient
2018-06-13 09:04:04 -05:00
Cody Soyland
0b16a3afb9
Merge branch 'develop' into http-inversion
2018-06-12 14:49:54 -05:00
Cody Soyland
f2c104dfef
Migrate HTTP handler and client into http subpackage.
2018-06-12 13:22:40 -05:00