Cody Soyland
3f7067f895
Add Pilosa 1.4 upgrading instructions to docs
2019-09-17 16:33:35 -05:00
Cody Soyland
c8f8687a22
Fix typo
2019-09-17 16:01:21 -05:00
Cody Soyland
7e9d95f307
Add warning about int fields
2019-09-17 16:01:21 -05:00
Cody Soyland
6efde37fb4
Update CHANGELOG.md
...
Co-Authored-By: alanbernstein <alanaaronbernstein@gmail.com>
2019-09-17 15:59:28 -05:00
Cody Soyland
53365ed967
Release v1.4.0
2019-09-17 14:47:59 -05:00
Cody Soyland
69f3acac5c
Merge pull request #2064 from codysoyland/ci-updates
...
Update CirleCI build with Go 1.13 and run enterprise tests
2019-09-17 14:20:52 -05:00
Cody Soyland
3db1a91fa0
Add minimum Go version to go.mod
2019-09-17 13:40:16 -05:00
Cody Soyland
aa7030a646
Update Go version in Circle dependencies
2019-09-17 13:40:05 -05:00
Cody Soyland
8e208569e8
Remove build tag that break enterprise build
2019-09-17 13:34:28 -05:00
Cody Soyland
f8f9d0e3d1
Update golangci-lint
2019-09-17 13:33:54 -05:00
Cody Soyland
ce59aa102e
Update CirleCI build with Go 1.13 and run enterprise tests
2019-09-17 12:58:35 -05:00
alanbernstein
f1216fd35d
Merge pull request #2054 from alanbernstein/query-language-fixes
...
Minor fixes to query language docs
2019-09-17 11:27:34 -05:00
alanbernstein
b17fd34ad9
Merge branch 'master' into query-language-fixes
2019-09-17 09:02:23 -05:00
alanbernstein
a99294a30e
Merge pull request #2063 from alanbernstein/docs-fixes-again
...
Add Groupby and Rows to glossary, fix small issues
2019-09-16 17:02:01 -05:00
Alan Bernstein
01cfd4adcf
Add Groupby and Rows to glossary, fix small issues
2019-09-16 13:34:56 -05:00
alanbernstein
cc05218592
Merge pull request #2062 from alanbernstein/docs-typo-fixes
...
Minor formatting and typo fixes
2019-09-13 22:20:46 -05:00
Alan Bernstein
7eb68dd99a
Minor formatting and typo fixes
2019-09-13 16:40:56 -05:00
Alan Bernstein
f7554a3cd4
Add GroupBy filter response, use sensible field names
2019-08-14 11:37:21 -05:00
Alan Bernstein
af954322cf
Minor fixes to query language docs
2019-08-13 14:54:52 -05:00
seebs
bc9747cc0f
Merge pull request #1988 from seebs/startupspeed
...
WIP: address some startup speed and performance issues
2019-08-07 12:38:52 -05:00
seebs
484c51b6e0
Merge branch 'master' into startupspeed
2019-08-07 11:32:56 -05:00
Matt Jaffee
b84eada521
rename file and add license header
2019-08-07 08:09:04 -05:00
seebs
1e99c5346f
Merge pull request #2 from jaffee/startupspeed-breakout
...
generalize test strings and break out old UnmarshalBinary code
2019-08-05 18:01:16 -05:00
Matt Jaffee
fba496bc91
generalize test strings and break out old UnmarshalBinary code
...
(don't use iterator for unmarshalBinary)
2019-08-05 17:39:47 -05:00
Travis Turner
a5aa6e48a5
Merge pull request #2050 from travisturner/bsi-base-value
...
Default BSI base value to min, max, or 0 depending on the min/max range
2019-07-31 13:06:51 -05:00
Travis Turner
96e6c11897
add bsiBase() helper function to avoid duplication
2019-07-31 12:43:05 -05:00
Travis Turner
9e9103d98f
apply default base logic to BSI v1 migration code
2019-07-31 11:38:36 -05:00
Travis Turner
c5140ba88d
default BSI base value to min, max, or 0 depending on the min/max range
2019-07-31 09:19:04 -05:00
Travis Turner
a0560a0405
Merge pull request #2048 from travisturner/ingest-worker-pool
...
Add a worker pool for importRoaring jobs
2019-07-26 13:41:22 -05:00
Travis Turner
1af4219c62
Merge branch 'master' into ingest-worker-pool
2019-07-26 13:24:01 -05:00
Matthew Jaffee
c1f8216b3a
Merge pull request #2041 from pilosa/uip-time-only
...
use union in place when computing time ranges to avoid excessive allocation
2019-07-26 13:05:23 -05:00
seebs
e8bade6174
Merge branch 'master' into uip-time-only
2019-07-26 12:30:10 -05:00
Travis Turner
e044712675
add close() method to api
2019-07-26 11:34:29 -05:00
Seebs
1d732e4b7f
drop unused functions from previous unmarshal implementation
2019-07-25 16:11:57 -05:00
Seebs
2d9ca0888f
Use work queue for opening/closing fragments
...
When starting up, we can have a large number of views, each
with some number of fragments, and by default these were being
opened sequentially. There's no real benefit to that; they're
all nicely independent from each other and don't need much
locking, so we implement a trivial semaphore and launch the
operations asynchronously. We also combine them into
errgroups.
Similarly, we do this for fields and views, capping the number
of fields (or views) opened in parallel to avoid hitting a
system-wide limit on threads created (oops). Note that the
limits are shared, not multiplicative; we cap this fairly
arbitrarily at 8 fields being opened, and 16 views being opened,
at a time, but NumCPU*2 fragments being opened by those views.
This dramatically increases CPU load during startup, but doesn't
seem to significantly increase total CPU time, it just scales
much better on machines with lots of cores.
2019-07-25 16:03:24 -05:00
Seebs
b04037900c
move to using roaring iterators for UnmarshalBinary
...
The new roaring iterator used for the remap and importroaring
things could also be used for unmarshalling roaring streams,
and it's a slightly simpler design that doesn't need two passes
through the data. This patch cleans that up a bit, makes it work
better with ops logs, and uses that instead. It appears to
noticably but not immensely reduce the time imports take, but it
also gets us back down to one thing parsing roaring formats.
There are a couple of subtle changes to errors we were testing
for in various tests, and one of the fuzz tests goes away because
it was actually itself an erroneous error message -- it was reporting
the header of a roaring file as an invalid op because the op log
reader was running on the header for roaring files with zero
containers. Oops.
2019-07-25 16:03:18 -05:00
Seebs
29a1db4550
add "holder" command to start up and shut down
...
It would be neat to be able to observe performance of
"just open the holder". So let's make that a verb.
2019-07-25 15:38:38 -05:00
Ashley Svetlik
e028640ba2
Merge pull request #2045 from asvetlik/pdk2
...
Updated PDK
2019-07-25 15:33:58 -05:00
Travis Turner
ea29759774
adds a worker pool for importRoaring jobs
2019-07-25 11:41:47 -05:00
Matt Jaffee
5b655418b1
add another single day query test
2019-07-25 08:12:19 -05:00
Matt Jaffee
2c311e685e
add bounds check when getting time rows
2019-07-25 08:12:19 -05:00
Seebs
ff153459ee
union many things at once to cut down allocations
2019-07-25 08:12:19 -05:00
Ashley Svetlik
ae4d86e69a
Merge branch 'master' into pdk2
2019-07-24 16:45:05 -05:00
Ashley Svetlik
7320eeac4d
Merge pull request #2046 from asvetlik/admin2
...
Updated Open File Limit in Administration Doc
2019-07-24 16:02:00 -05:00
Ashley Svetlik
e45d03687b
Improved wording in text and table
2019-07-24 10:49:47 -05:00
Ashley Svetlik
6e6c591f62
Added max url links
2019-07-24 10:41:54 -05:00
Ashley Svetlik
27e62c40cf
Improved Open File Limit section wording
2019-07-24 10:22:09 -05:00
Ashley Svetlik
be218fd963
Updated Open File Limit Section
2019-07-24 09:38:06 -05:00
Ashley Svetlik
6d58db4fc9
Updated Pilosa Schema table and added pdk repo link
2019-07-24 09:32:18 -05:00
Matthew Jaffee
bd00f1bfe2
Merge pull request #2034 from jaffee/worker-pool
...
Worker pool
2019-07-15 14:48:39 -05:00
