164 commits

Author	SHA1	Message	Date
Yuce Tekol	eb9e609794	Merged with master	2018-11-26 17:03:38 +03:00
Ben Johnson	8e49332b25	Add distributed tracing.	2018-11-21 15:08:33 -06:00
Yuce Tekol	12112e0aef	Merged with master; check for empty roaring data	2018-11-21 18:22:40 +03:00
Yuce Tekol	2c91bf69b3	Merge branch 'master' into translate-keys-endpoint	2018-11-21 16:38:23 +03:00
Yuce Tekol	9c05155db4	Added /internal/translate/keys endpoint	2018-11-21 16:35:50 +03:00
Yuce Tekol	1faa789b31	remove ImportRoaringRequestView type	2018-11-21 14:53:16 +03:00
Matt Jaffee	65f478470f	logging cleanup - start with lowercase unless reporting error or warning	2018-11-20 14:08:06 -06:00
Seebs	a203313143	move Logger and Stats to their own packages ... I'd like to add stat tracking to Roaring, which means it has to be able to import the stats package, which means stats has to be a package rather than part of the pilosa package. If stats stops being in pilosa, it still needs a way to import logger, so logger also has to leave the pilosa package. Then everything using them needs to import them and use package selectors on their names. This doesn't actually add the stats support to roaring, it just makes it so there's a way to import the stats code from something in the roaring package.	2018-11-15 15:10:44 -06:00
Yuce Tekol	70f85211d9	prevent panic in Bitmap.UnmarshalBinary when there is no data	2018-11-15 22:06:21 +03:00
Yuce Tekol	2bab6eb5ec	enable roaring import for time fields; build view name	2018-11-14 16:31:09 +03:00
Yuce Tekol	84c04900e1	Import roaring enpoint accepts a list of views	2018-11-12 18:43:59 +03:00
Travis Turner	063caed8d1	forward imports to non-coordinator shards	2018-11-05 17:39:42 -06:00
Travis Turner	f02605a528	consolidate ImportOptions setup. use url.Values{}. fix comments.	2018-10-23 17:37:57 -05:00
Travis Turner	5fb6ef224c	add clear support for ImportRoaring	2018-10-23 17:37:57 -05:00
Travis Turner	a7a15c64a2	support clear imports to int fields. fix bug in fragment.sum	2018-10-23 17:37:57 -05:00
Travis Turner	caf8e06712	add clear functional option for imports	2018-10-23 17:37:57 -05:00
Ben Johnson	f8608227d1	Add DeleteAvailableShard() ... This commit adds the ability to remove an 'available shard' from the shard cache. This does not affect shards known to be available because of local data.	2018-10-17 08:50:06 -06:00
Yuce Tekol	a028d4604a	Merge branch 'master' into 1632-move-columnattrs	2018-10-05 15:16:17 +03:00
Yuce Tekol	efed5ea3fc	Fixes #1632	2018-10-03 13:43:15 +03:00
Yuce Tekol	fc6fc82f67	use FieldTypeSet	2018-10-01 17:55:56 +03:00
Yuce Tekol	066c3a4853	Fixes #1660	2018-10-01 14:15:51 +03:00
Travis Turner	1039390686	fixes pass-by-value issue in proto decode	2018-09-24 13:11:54 -05:00
Travis Turner	e7481f4fd2	treat import timestamps as UTC	2018-09-19 16:17:09 -05:00
Matt Jaffee	495af54c10	Merge branch 'master' into roaring-import	2018-09-13 15:50:16 -05:00
Matt Jaffee	870c5e131f	replace waitgroup with errgroup to avoid race on err	2018-09-13 15:27:00 -05:00
Matt Jaffee	f943c17e0b	ImportRoaring, add remote arg, fix data copy bug ... also, handle err properly in client method instead of discarding.	2018-09-13 15:05:05 -05:00
Matt Jaffee	b412309447	rename standard roaring to "official" throughout	2018-09-13 13:38:18 -05:00
Matt Jaffee	7b0d4d75b4	remove validators on import-roaring and test handler ... validators are for query args, not url vars. Also some misc cleanup and error handling in the handler.	2018-09-13 13:14:35 -05:00
Matt Jaffee	fd655c998e	rename all instances of roaringbytes ... function names now importRoaring and byte slice args are just called data. Also renamed http endpoint from /importroaring to /import-roaring	2018-09-13 12:27:23 -05:00
Matt Jaffee	f006df7758	re-order ImportRoaringBytes args to be more consistent	2018-09-13 10:39:00 -05:00
Matt Jaffee	c6817340c7	rename sliceWidth->shardWidth	2018-09-13 10:31:58 -05:00
Matt Jaffee	3bc9c66f5e	remove some naked returns and simplify	2018-09-12 17:21:17 -05:00
Matt Jaffee	b5a14de1fd	roaring import: fix api doc, refactor/rename, test merge	2018-09-12 16:11:51 -05:00
Matt Jaffee	8254d0fadd	improve import roaring docs, check errors	2018-09-12 12:08:57 -05:00
Matt Jaffee	cf47950bd7	gofmt all	2018-09-12 10:06:03 -05:00
Travis Turner	f7abf60627	add lock around existencFld	2018-09-11 15:15:37 -05:00
Travis Turner	9b4c67ee60	rename notnull to exists	2018-09-11 15:15:37 -05:00
Travis Turner	3d7fc0c1c6	remove unnecessary timestamp slice allocation	2018-09-11 15:14:58 -05:00
Travis Turner	4c67cb18ed	update notnull field on imports	2018-09-11 15:13:56 -05:00
Yuce Tekol	408a3531ec	updated comment	2018-09-11 22:18:31 +03:00
Yuce Tekol	70d386039f	trivial	2018-09-11 20:47:15 +03:00
Yuce Tekol	465028e9c3	Renamed Query to Opt; added multiple Opt test	2018-09-11 17:19:12 +03:00
Yuce Tekol	70ceb5809b	Added columnAttrs to Query call	2018-09-11 11:42:00 +03:00
Todd Gruben	93e5767325	cleanup #1622	2018-09-06 16:27:10 -05:00
Travis Turner	8a1f8659fa	change test to use exported UnmarshalStandardRoaring()	2018-09-05 10:13:15 -05:00
Todd Gruben	cc80e0b0e4	initial support for bulk importing standard roaring files per shard	2018-09-05 10:13:15 -05:00
Ben Johnson	f4c9c0fed3	Maintain available shards set. ... This commit removes the previous `MaxShard` tracking and replaces it with an `Available Shards` set tracking. This allows sparse shard tracking without implicitly tracking all shards in between.	2018-08-22 07:57:58 -06:00
Travis Turner	6b75988b71	add key translation to exports	2018-08-20 13:40:58 -05:00
Matt Jaffee	e16c43c3bc	Merge branch 'master' into 1492-ae-and-resize	2018-08-20 09:13:35 -05:00
Travis Turner	f1a460aca7	adds view parameter to sync logic for syncing time fields	2018-08-16 11:27:08 -05:00