Matt Jaffee
9e6662fb00
send POSTed schema to all nodes in cluster
...
also fix a *bunch* of tests that weren't closing the clusters they
created. Cleaned up one test to use t.Run instead of just checking
everything in a loop
2019-04-29 19:31:23 -05:00
Seebs
449c853850
address meta-lint or half-baked lint fixes
...
Clean up some spelling and consistency issues for the lint
fixes.
2019-04-16 12:08:40 -05:00
Seebs
9fc8a5b352
handle a specific error that might be an expected error
...
I'm honestly not sure here.
2019-04-16 12:07:18 -05:00
Seebs
79451bd53c
undo accidental change to test case contents
2019-04-16 12:07:18 -05:00
Seebs
77d49ded64
so much lint
...
So with the switch to a new linter, we get a lot of new warnings,
and the majority of them are harmless probably, but a few might be
real. Variously just use _ to suppress warnings, or report errors.
There's probably things here that deserve better fixes, but we can
always revisit it.
2019-04-16 12:07:18 -05:00
Matt Jaffee
599b2f4a9e
implement config options for block profile rate and mutex fraction
...
set sane defaults. The performance overhead seems to be negligible, and this will allow us to obtain mutex and blocking profiles from running Pilosas by default.
2019-03-25 11:38:01 -05:00
Matt Jaffee
e7f65cf7be
implement global open file counter using syswrap
...
close files after using them if global max is passed.
I originally implemented this without the global count—just always closing files
when done with them, and reopening for new writes. This was crazy slow for that
one test that uses mustSetBits in a big loop. I modified the test to use
importRoaring and everything worked better (though much more slowly).
After adding the global counter, I ran the tests with that one test using
mustSetBits again, and the performance was similar to master. After completing
this PR, I ran the tests with the max limit set to 5—they still passed but were
much slower.
2019-03-23 14:52:16 -05:00
Matt Jaffee
e469285fe3
add fragment mmap tracking and limiting
...
in the case that the map limit is reached, we'll fall back to reading the file
into memory normally.
2019-03-19 12:55:26 -05:00
Matt Jaffee
52fe460f84
improve help for metrics options
2019-03-04 17:36:01 -06:00
Travis Turner
efb9f97e61
Advertise address and listen on 0.0.0.0
...
This commit adds support for advertise address by using a new config
option `advertise`, or by defaulting its value to that
specified in `bind`.
Also adds support for listening on 0.0.0.0 by trying to determine
the preferred outbound IP to use for the advertise address.
2019-01-21 22:36:55 -06:00
Matt Jaffee
daa87d8e12
fix staticcheck warnings
2019-01-21 14:24:11 -06:00
Travis Turner
358c32a165
add test for translate store buffer growth logic. add max limit to buffer size.
2018-12-18 12:48:20 -06:00
Cody Soyland
983f7c95af
Add flag --tracing.agent-host-port
2018-11-21 15:08:33 -06:00
Ben Johnson
8e49332b25
Add distributed tracing.
2018-11-21 15:08:33 -06:00
Yuce Tekol
fc231ff802
Fixes #1731
2018-11-08 17:01:05 +03:00
Travis Turner
a7a15c64a2
support clear imports to int fields. fix bug in fragment.sum
2018-10-23 17:37:57 -05:00
Travis Turner
caf8e06712
add clear functional option for imports
2018-10-23 17:37:57 -05:00
Travis Turner
4f17dbdbf1
add support for Bool fields
...
prevent import of non-boolean row values to bool fields
2018-09-21 09:25:41 -05:00
Cody Soyland
52ba336461
Address code review feedback
2018-09-20 16:05:28 -05:00
Cody Soyland
7a32745b28
Make translate map size configurable.
2018-09-19 12:35:00 -05:00
Matt Jaffee
495af54c10
Merge branch 'master' into roaring-import
2018-09-13 15:50:16 -05:00
Matt Jaffee
d3717e2afe
make Bitmap.UnmarshalBinary work for roaring or pilosa format
2018-09-12 10:50:05 -05:00
Yuce Tekol
81f126dd34
Added field options to pilosa import
2018-09-06 17:04:07 +03:00
Yuce Tekol
48bd76b967
Removed --string-keys option from pilosa import
2018-09-05 22:58:23 +03:00
Yuce Tekol
7b872e00cb
Implements #1570
2018-09-05 17:10:56 +03:00
Travis Turner
177f25ee44
Add tests for importing value with column keys into integer fields.
...
Fix a bug in protofuf decoding of pilosa.Row.
2018-08-15 16:00:32 -05:00
Travis Turner
bf4e2e598b
add support for column keys when importing to int fields
2018-08-15 16:00:31 -05:00
Travis Turner
2f892e5e80
change string-keys DEPRECATED message to REMOVED
2018-08-15 14:55:02 -05:00
Travis Turner
6a327a26fe
add deprecation warnings for --string-keys flag
2018-08-15 10:31:27 -05:00
Travis Turner
862dabe27d
address review comments
2018-08-14 14:37:51 -05:00
Travis Turner
0a6f0e92d8
add tests to cover the coordinator logic for multi-node clusters
2018-08-14 13:58:37 -05:00
Travis Turner
fd96d3a02e
This commit ensures that keyed imports are sent to the coordinator
...
node (as opposed to sending to shard0, which may or may not be the
coordinator). It adds a `Nodes()` method to the `InternalClient`
which is used by the importer to determine which node is the
coordinator.
2018-08-14 12:34:17 -05:00
Ben Johnson
a31a08c330
Support keys on import CLI.
2018-08-14 09:32:39 -05:00
Travis Turner
b304de6536
Treat coordinator as primary translate store.
...
Daisy-chain other nodes based on their position in the cluster.
Deprecate the `primary-url` configuration option.
2018-08-13 11:06:16 -05:00
Cody Soyland
f01d850b17
Fix linter issues: gosimple
2018-07-20 09:06:43 -05:00
Cody Soyland
de99b5720f
Fix linter issues: vet
2018-07-19 11:37:50 -05:00
Cody Soyland
187ded0a52
Fix linter issues: maligned
2018-07-19 11:07:59 -05:00
Cody Soyland
d4510172d3
Fix linter issues: ineffassign
2018-07-18 14:02:56 -05:00
Cody Soyland
f9625ef4fa
Fix linter issues: unparam
2018-07-17 12:05:07 -05:00
Cody Soyland
eea29f664f
Unexport ctl.ImportCommand.Client
2018-07-05 23:11:56 -05:00
Cody Soyland
f9a792ea49
Unexport ctl.ImportCommand.IndexOptions
2018-07-05 23:11:56 -05:00
Cody Soyland
7185c0f791
Unexport ctl.CommandClient
2018-07-05 23:11:56 -05:00
Matt Jaffee
5ff77c816a
get rid of unecessary server stuff and export node and uri
2018-07-03 13:26:51 -05:00
Travis Turner
5dd7a9556a
rename slice to shard
2018-06-28 14:07:07 -05:00
Cody Soyland
824474160e
Enhance test utilities (introduce Cluster type, improve naming)
2018-06-28 13:34:58 -05:00
Travis Turner
22661f3571
Merge branch 'develop' into field-options
2018-06-28 10:20:17 -05:00
Matt Jaffee
9998eda3d4
remove Server.Addr - use URI instead
2018-06-27 13:37:08 -05:00
Travis Turner
028e95d914
Allow a single functional option for field options.
...
Move field type specific validation to functional options.
2018-06-26 10:37:56 -05:00
Travis Turner
50794bf63b
move fieldOptions unmarshal to the handler
...
validate fieldOptions in http package
2018-06-25 15:14:22 -05:00
Matt Jaffee
8878b02345
cleanup - address review feedback
2018-06-25 11:08:00 -05:00
