Yuce Tekol
5f4c5d4d35
added test for 1977 fix
2019-05-28 13:54:12 +03:00
Matt Jaffee
de61d04172
failing test for group by with filter using string keys
...
also, apparently our API code was assuming that imports with keys
always had timestamps which seemed wrong, so I fixed that.
2019-05-10 13:55:21 -05:00
Matt Jaffee
61bf3d929d
Add more tracing and metdata to importRoaring
2019-04-30 15:49:52 -05:00
Matt Jaffee
9e6662fb00
send POSTed schema to all nodes in cluster
...
also fix a *bunch* of tests that weren't closing the clusters they
created. Cleaned up one test to use t.Run instead of just checking
everything in a loop
2019-04-29 19:31:23 -05:00
Matt Jaffee
0ef3e5e144
add ability to post schema using holder.applySchema
...
New API warning: this adds ApplySchema to pilosa.API and allows
POSTing to the /schema endpoint
2019-04-25 16:03:44 -05:00
Travis Turner
b46ff7b990
fix some lint warnings raised in VS-Code
2019-04-17 18:10:05 -05:00
Seebs
5ee87bbf7c
add server stats to /info endpoint
...
report the approximate hardware specs (CPU speed, cores, memory)
of the server in the /info endpoint. This may be useful when
benchmarking.
We do some workarounds because gopsutil's core count output is
confusingly different between Linux and Darwin, and the MHz output
is usually wrong on Linux. Intel's app notes say to just parse
the model string. Whyyyyyyy.
2019-03-26 09:14:51 -05:00
Todd Gruben
e3fe55522d
comment adjustments
2019-02-19 10:54:09 -06:00
Todd Gruben
02ed4568dd
gofmt
2019-02-19 10:25:34 -06:00
Todd Gruben
a13e5fafa4
updated comments and added error wrapping
2019-02-19 10:19:17 -06:00
Todd Gruben
ffe1a285bd
removed copy for pilosa roaring files
2019-02-18 16:28:37 -06:00
Travis Turner
ca2241731d
fix tracing message. prevent reallocation of availableShards
2018-12-18 08:34:48 -06:00
Travis Turner
84fddbc67f
Replace the /fragment/data endpoint to support cluster resizing
2018-12-18 08:34:47 -06:00
Travis Turner
c66daabc81
convert the anti-entropy logic to use ImportRoaring instead of QueryNode
2018-12-10 21:05:08 -06:00
Yuce Tekol
eb9e609794
Merged with master
2018-11-26 17:03:38 +03:00
Ben Johnson
8e49332b25
Add distributed tracing.
2018-11-21 15:08:33 -06:00
Yuce Tekol
12112e0aef
Merged with master; check for empty roaring data
2018-11-21 18:22:40 +03:00
Yuce Tekol
2c91bf69b3
Merge branch 'master' into translate-keys-endpoint
2018-11-21 16:38:23 +03:00
Yuce Tekol
9c05155db4
Added /internal/translate/keys endpoint
2018-11-21 16:35:50 +03:00
Yuce Tekol
1faa789b31
remove ImportRoaringRequestView type
2018-11-21 14:53:16 +03:00
Matt Jaffee
65f478470f
logging cleanup - start with lowercase unless reporting error or warning
2018-11-20 14:08:06 -06:00
Seebs
a203313143
move Logger and Stats to their own packages
...
I'd like to add stat tracking to Roaring, which means it
has to be able to import the stats package, which means
stats has to be a package rather than part of the pilosa
package. If stats stops being in pilosa, it still needs
a way to import logger, so logger also has to leave the
pilosa package. Then everything using them needs to import
them and use package selectors on their names.
This doesn't actually add the stats support to roaring,
it just makes it so there's a way to import the stats
code from something in the roaring package.
2018-11-15 15:10:44 -06:00
Yuce Tekol
70f85211d9
prevent panic in Bitmap.UnmarshalBinary when there is no data
2018-11-15 22:06:21 +03:00
Yuce Tekol
2bab6eb5ec
enable roaring import for time fields; build view name
2018-11-14 16:31:09 +03:00
Yuce Tekol
84c04900e1
Import roaring enpoint accepts a list of views
2018-11-12 18:43:59 +03:00
Travis Turner
063caed8d1
forward imports to non-coordinator shards
2018-11-05 17:39:42 -06:00
Travis Turner
f02605a528
consolidate ImportOptions setup. use url.Values{}. fix comments.
2018-10-23 17:37:57 -05:00
Travis Turner
5fb6ef224c
add clear support for ImportRoaring
2018-10-23 17:37:57 -05:00
Travis Turner
a7a15c64a2
support clear imports to int fields. fix bug in fragment.sum
2018-10-23 17:37:57 -05:00
Travis Turner
caf8e06712
add clear functional option for imports
2018-10-23 17:37:57 -05:00
Ben Johnson
f8608227d1
Add DeleteAvailableShard()
...
This commit adds the ability to remove an 'available shard'
from the shard cache. This does not affect shards known to be
available because of local data.
2018-10-17 08:50:06 -06:00
Yuce Tekol
a028d4604a
Merge branch 'master' into 1632-move-columnattrs
2018-10-05 15:16:17 +03:00
Yuce Tekol
efed5ea3fc
Fixes #1632
2018-10-03 13:43:15 +03:00
Yuce Tekol
fc6fc82f67
use FieldTypeSet
2018-10-01 17:55:56 +03:00
Yuce Tekol
066c3a4853
Fixes #1660
2018-10-01 14:15:51 +03:00
Travis Turner
1039390686
fixes pass-by-value issue in proto decode
2018-09-24 13:11:54 -05:00
Travis Turner
e7481f4fd2
treat import timestamps as UTC
2018-09-19 16:17:09 -05:00
Matt Jaffee
495af54c10
Merge branch 'master' into roaring-import
2018-09-13 15:50:16 -05:00
Matt Jaffee
870c5e131f
replace waitgroup with errgroup to avoid race on err
2018-09-13 15:27:00 -05:00
Matt Jaffee
f943c17e0b
ImportRoaring, add remote arg, fix data copy bug
...
also, handle err properly in client method instead of discarding.
2018-09-13 15:05:05 -05:00
Matt Jaffee
b412309447
rename standard roaring to "official" throughout
2018-09-13 13:38:18 -05:00
Matt Jaffee
7b0d4d75b4
remove validators on import-roaring and test handler
...
validators are for query args, not url vars. Also some misc cleanup and error
handling in the handler.
2018-09-13 13:14:35 -05:00
Matt Jaffee
fd655c998e
rename all instances of roaringbytes
...
function names now importRoaring and byte slice args are just called data. Also
renamed http endpoint from /importroaring to /import-roaring
2018-09-13 12:27:23 -05:00
Matt Jaffee
f006df7758
re-order ImportRoaringBytes args to be more consistent
2018-09-13 10:39:00 -05:00
Matt Jaffee
c6817340c7
rename sliceWidth->shardWidth
2018-09-13 10:31:58 -05:00
Matt Jaffee
3bc9c66f5e
remove some naked returns and simplify
2018-09-12 17:21:17 -05:00
Matt Jaffee
b5a14de1fd
roaring import: fix api doc, refactor/rename, test merge
2018-09-12 16:11:51 -05:00
Matt Jaffee
8254d0fadd
improve import roaring docs, check errors
2018-09-12 12:08:57 -05:00
Matt Jaffee
cf47950bd7
gofmt all
2018-09-12 10:06:03 -05:00
Travis Turner
f7abf60627
add lock around existencFld
2018-09-11 15:15:37 -05:00
