Matt Jaffee
870c5e131f
replace waitgroup with errgroup to avoid race on err
2018-09-13 15:27:00 -05:00
Matt Jaffee
f943c17e0b
ImportRoaring, add remote arg, fix data copy bug
...
also, handle err properly in client method instead of discarding.
2018-09-13 15:05:05 -05:00
Matt Jaffee
b412309447
rename standard roaring to "official" throughout
2018-09-13 13:38:18 -05:00
Matt Jaffee
b2ec5e373e
fixup explanatory comment
2018-09-13 13:33:51 -05:00
Matt Jaffee
7b0d4d75b4
remove validators on import-roaring and test handler
...
validators are for query args, not url vars. Also some misc cleanup and error
handling in the handler.
2018-09-13 13:14:35 -05:00
Matt Jaffee
fd655c998e
rename all instances of roaringbytes
...
function names now importRoaring and byte slice args are just called data. Also
renamed http endpoint from /importroaring to /import-roaring
2018-09-13 12:27:23 -05:00
Matt Jaffee
9e7cfeedc9
readability changes in fragment.go
2018-09-13 11:41:46 -05:00
Matt Jaffee
af7d405b11
add explanatory comment and move comment to correct spot
2018-09-13 10:41:36 -05:00
Matt Jaffee
f006df7758
re-order ImportRoaringBytes args to be more consistent
2018-09-13 10:39:00 -05:00
Matt Jaffee
c6817340c7
rename sliceWidth->shardWidth
2018-09-13 10:31:58 -05:00
Matt Jaffee
79c783eaf8
add nolint directive
...
there isn't much piont in making snapshot take a WriterTo, because the only
thing that's going to be written to a fragment is a roaring bitmap. making it
WriterTo just makes it slightly more annoying to jump into the Bitmap.WriterTo
implementation. since it's a private function, it should be straightforward to
change this in the future if the need arises.
2018-09-12 17:31:57 -05:00
Matt Jaffee
4a5f12631c
more naked returns
2018-09-12 17:29:35 -05:00
Matt Jaffee
d0d0bdd722
simplify fragment.unprotectedRow (unparam)
2018-09-12 17:25:12 -05:00
Matt Jaffee
3bc9c66f5e
remove some naked returns and simplify
2018-09-12 17:21:17 -05:00
Matt Jaffee
70e9da3b75
fmt -s fragment_internal_test
2018-09-12 17:13:07 -05:00
Matt Jaffee
f8569102f5
update some fragment comments re: the cache
2018-09-12 17:10:28 -05:00
Matt Jaffee
3ea07ae3a7
use cache.Recalculate instead of Invalidate for imports
...
Invalidate does not always rebuild the cache - if the last rebuild is < 10s ago,
it does nothing. We always want to rebuild the cache after imports.
Also updated the comments around recalculate/invalidate to clarify.
2018-09-12 17:07:46 -05:00
Matt Jaffee
14a8362261
roaring import - add cache invalidate and broken test
2018-09-12 16:48:07 -05:00
Matt Jaffee
b5a14de1fd
roaring import: fix api doc, refactor/rename, test merge
2018-09-12 16:11:51 -05:00
Matt Jaffee
a3243f99e1
linter fixes - reorder return vals, remove unused const
2018-09-12 13:24:59 -05:00
Todd Gruben
156260e68e
roaring allowed import to merge with existing data
2018-09-12 13:20:07 -05:00
Matt Jaffee
8254d0fadd
improve import roaring docs, check errors
2018-09-12 12:08:57 -05:00
Matt Jaffee
d3717e2afe
make Bitmap.UnmarshalBinary work for roaring or pilosa format
2018-09-12 10:50:05 -05:00
Matt Jaffee
cf47950bd7
gofmt all
2018-09-12 10:06:03 -05:00
tgruben
5589324865
Merge branch 'master' into roaring-import
2018-09-06 16:28:38 -05:00
Todd Gruben
93e5767325
cleanup #1622
2018-09-06 16:27:10 -05:00
Travis Turner
69467f31f9
Merge pull request #1626 from travisturner/testing-TB
...
replace *testing.T with interface testing.TB
2018-09-06 11:31:15 -05:00
Travis Turner
a6f22eb8b3
replace *testing.T with interface testing.TB
2018-09-06 09:43:21 -05:00
Yuce Tekol
0ac1e25a07
Merge pull request #1621 from yuce/1570-import-cmd-keys-options
...
Adds --field-keys and --index-keys options to pilosa import
2018-09-06 05:56:04 +03:00
Yuce Tekol
4efd11bb1f
Merge branch 'master' into 1570-import-cmd-keys-options
2018-09-05 22:59:13 +03:00
Yuce Tekol
48bd76b967
Removed --string-keys option from pilosa import
2018-09-05 22:58:23 +03:00
Yuce Tekol
748a2d01e3
Merge pull request #1620 from yuce/1538-cmd-package
...
Use passed stdin, stdout and stderr in the cmd package. Fixes #1538
2018-09-05 21:45:09 +03:00
Travis Turner
8a1f8659fa
change test to use exported UnmarshalStandardRoaring()
2018-09-05 10:13:15 -05:00
Todd Gruben
de478870fb
found deadlock in new code
2018-09-05 10:13:15 -05:00
Todd Gruben
1d99da1f28
added support for both pilosa and standard roaring uploads
2018-09-05 10:13:15 -05:00
Todd Gruben
cc80e0b0e4
initial support for bulk importing standard roaring files per shard
2018-09-05 10:13:15 -05:00
Todd Gruben
019ca63cf4
add support for reading standard roaring bitmaps to pilosa/roaring.
2018-09-05 10:13:15 -05:00
Yuce Tekol
fe1208ac65
Fix std{in,out,err} in export cmd
2018-09-05 17:37:44 +03:00
Yuce Tekol
7b872e00cb
Implements #1570
2018-09-05 17:10:56 +03:00
Yuce Tekol
480c853a3e
Use passed stdin, stdout and stderr in the cmd package. Fixes #1538
2018-09-05 16:23:31 +03:00
Yuce Tekol
6c43f1aad7
Merge pull request #1614 from yuce/client-doc-update
...
Updated Go client sample to match latest master
2018-09-04 19:24:39 +03:00
Yuce Tekol
0b38a4d956
updated go client sample to match latest master
2018-08-29 23:13:04 +03:00
Travis Turner
10eea2db4c
Merge pull request #1600 from benbjohnson/available-shards
...
Maintain available shards set
2018-08-23 07:32:37 -05:00
Ben Johnson
f4c9c0fed3
Maintain available shards set.
...
This commit removes the previous `MaxShard` tracking and replaces
it with an `Available Shards` set tracking. This allows sparse shard
tracking without implicitly tracking all shards in between.
2018-08-22 07:57:58 -06:00
Cody Soyland
b22780ccf1
Merge pull request #1611 from codysoyland/release-v1.1.0
...
Release v1.1.0
2018-08-21 13:12:29 -05:00
Cody Soyland
bc890f83f3
Add link to v1.1 diff
2018-08-21 13:03:07 -05:00
Cody Soyland
944d8de154
Travis has good grammar
2018-08-21 13:01:48 -05:00
Cody Soyland
3cb8a10cbd
Release v1.1.0
2018-08-21 12:19:22 -05:00
Cody Soyland
83dee41478
Update CHANGELOG with changes from v1.0 branch
2018-08-21 11:52:22 -05:00
Cody Soyland
b9f947db15
Merge pull request #1610 from codysoyland/circleci
...
Add CircleCI
2018-08-21 11:15:59 -05:00
