Commit graph

5199 commits

Author SHA1 Message Date
Fletcher Haynes
383ce50b95 Updated Dockerfiles for lattice to use a publicly available container in the GitHub container registry 2022-09-08 11:05:43 -07:00
Fletcher Haynes
0c19c87a40 Merge branch 'master' of github.com:pilosa/pilosa 2022-09-06 09:39:51 -07:00
Fletcher Haynes
da9b57bd45 Updated dependency paths to reflect new repo location 2022-09-06 09:39:22 -07:00
Kasey
acf94f318b
Merge pull request #2160 from FeatureBaseDB/README-corrections
chore:correct README typo
2022-09-02 14:03:28 -07:00
Kasey Rodgers
6d326a4974 chore:correct README typo 2022-09-02 13:58:44 -07:00
Fletcher Haynes
eb06bb50ae Updated code to latest version for open-sourcing. 2022-09-02 13:23:39 -07:00
Matthew Jaffee
227632544d
Merge pull request #2150 from pilosa/slack-link
Add slack link to readme
2021-12-14 10:56:22 -06:00
Alan Bernstein
0c39f7e4ea
Add slack link to readme 2021-12-13 20:16:11 -06:00
Travis Turner
8886da126f
Merge pull request #2137 from travisturner/backport-fix
fix interface{} -> bool err
2021-01-27 08:13:04 -06:00
Travis Turner
4681d50988
remove leftover commented code 2021-01-27 07:55:15 -06:00
wanggy
53c1fb6bbe
fix interface{} -> bool err 2021-01-26 21:53:13 -06:00
alanbernstein
d960d2fda9
Merge pull request #2130 from alanbernstein/temper-wsl-reference
Remove WSL references
2020-10-23 16:32:29 -05:00
Alan Bernstein
dd4572a4ca Remove suggestion of Windows support 2020-10-23 12:13:03 -05:00
Travis Turner
052440974a
Merge pull request #2125 from travisturner/fix-language-link
fix languages.txt link
2020-09-10 16:18:02 -05:00
Travis Turner
efd5663cc4
fix languages.txt link 2020-09-08 16:41:14 -05:00
Kuba Podgórski
689776b1c0
Merge pull request #2122 from kuba--/notfound-verbose
Make not found error more verbose (add name)
2020-08-27 21:56:32 +02:00
Kuba Podgórski
1f32fe05b0 Make not found error more verbose (add name) 2020-08-27 19:45:19 +02:00
Kuba Podgórski
55353a2567
Merge pull request #2119 from kuba--/union-run-run
Add unionRunRunInPlace
2020-07-16 12:37:01 +02:00
Kuba Podgórski
730fab38dc Add unionRunRunInPlace 2020-07-14 15:10:26 +02:00
Travis Turner
9dc1775b93
Merge pull request #2112 from travisturner/block-edge
Fix off-by-one maxRowID in block limits
2020-05-04 21:54:04 -05:00
Travis Turner
56adbfedfd
Fix off-by-one maxRowID in block limits 2020-05-04 17:29:53 -05:00
Kuba Podgórski
9426b9ee60
Merge pull request #2111 from kuba--/fix-groupby-iter
GroupBy should terminate even if the last result is empty
2020-04-29 16:07:39 +02:00
Kuba Podgórski
5f4a1d1668
Merge branch 'master' into fix-groupby-iter 2020-04-29 11:14:32 +02:00
Kuba Podgórski
1b3d0fd8a9
Merge pull request #2104 from sundy-li/holder-fix
holder.go: fix some logic errors
2020-04-29 11:14:11 +02:00
Kuba Podgórski
8678bc52ba
Merge branch 'master' into fix-groupby-iter 2020-04-27 17:51:13 +02:00
Kuba Podgórski
4e16a4c489
Merge branch 'master' into holder-fix 2020-04-27 17:50:26 +02:00
Kuba Podgórski
9cf9968b64
Merge pull request #2110 from seebs/roaring4go
Handle file sizes over 4GB
2020-04-27 17:49:44 +02:00
Kuba Podgórski
816b015cf3
Merge branch 'master' into holder-fix 2020-04-27 12:47:09 +02:00
Kuba Podgórski
06675c2f9c GroupBy should terminate even if the last result is empty 2020-04-27 12:43:15 +02:00
Seebs
827923e616 Handle file sizes over 4GB
We only have 4 bytes for offsets, but what if a file is
over 4GB? Someone came to us with a file with 265 *million* containers,
in a single fragment, which means that over 3GB of their 4.7GB file
is actually just the container headers alone. But we can't easily make
the offsets larger, or change the file format.

So we don't. We just track how many 4GB hunks of the file we've
been through and bump that every time the 32-bit offset wraps. And this
appears to... just work.

This is fixed for both the roaring iterator and the old unmarshalBinary
logic. The logic to handle this will work on 32-bit hosts in the sense
that it will correctly error out for excessively large file sizes or
container counts, but it doesn't actually handle the large files since
it can't.
2020-04-24 10:56:24 -05:00
Travis Turner
72d5081a44
Merge pull request #2105 from zhanglistar/master
1. modify unprotectedGenerateResizeJob to return early iif resizing job
2020-04-11 10:13:26 -05:00
Travis Turner
f4d1122fbc
Merge branch 'master' into master 2020-04-11 09:51:47 -05:00
zhanglistar
93b6adbf65 1. modify unprotectedGenerateResizeJob to return early iif resizing job
not null
2020-04-11 22:48:28 +08:00
Travis Turner
f5c2546c37
Merge pull request #2087 from travisturner/cache-size-none
Fix cacheSize when cacheType is none (and cacheSize is 0)
2020-04-09 09:29:18 -05:00
Kuba Podgórski
9cdaff542f
Update field_internal_test.go 2020-04-09 15:04:34 +02:00
Kuba Podgórski
4272693641
Update field_internal_test.go 2020-04-09 15:04:11 +02:00
Kuba Podgórski
b43065625a
Merge branch 'master' into cache-size-none 2020-04-09 12:37:44 +02:00
sundy-li
768c709937 holder.go: fix some logic errors 2020-04-08 16:35:42 +08:00
Kuba Podgórski
eb73042e82
Merge pull request #2100 from PierreF/runCountRange-bug
Fix offset-by-1 in CountRange with continuous bits interval
2020-03-17 18:57:27 +01:00
Pierre Fersing
e8ca41e522 Fix runCountRange when range start == interval start
When the interval is a proper superset of the range with start equal to
interval start, the range must be considered a superset or it will be
completly ignored (since it neither a subset nor it overlaps)
2020-03-13 10:47:39 +01:00
Kuba Podgórski
ac3a4abb4a
Merge pull request #2099 from kuba--/test-clear
Add extra Clear test (check if existency column bit is set)
2020-02-13 16:11:24 +01:00
Kuba Podgórski
377d14081a Add extra Clear test (check if existency column bit is set) 2020-02-13 15:20:03 +01:00
Kuba Podgórski
771cc3ae94
Merge pull request #2098 from kuba--/fix-2097
Update handler.go
2020-02-05 23:45:07 +01:00
Kuba Podgórski
4f0740ae4f Update handler.go 2020-02-05 22:17:45 +01:00
Kuba Podgórski
8ec1fef68a
Merge pull request #2096 from kuba--/simplify-holder
Simplify Holder's logic
2020-02-04 00:56:11 +01:00
Kuba Podgórski
b9fa6da5d2 Simplify Holder's logic 2020-02-03 18:12:15 +01:00
Travis Turner
7a032e62f0
Merge pull request #2088 from travisturner/test-2084
Add a test for pilosa/#2084
2019-11-13 10:12:21 -06:00
Travis Turner
4fb0712dab
add a test for pilosa/#2084 2019-11-12 12:05:36 -06:00
Travis Turner
8d716457d1
Merge pull request #2084 from travisturner/import-value-cache
Add logic that clears fragment.rowCache after importValue
2019-11-11 17:16:00 -06:00
Travis Turner
9273691e8d
move requiredDepth calculation after min/max ranges are checked
Without this, a data set with a ludicrously large value in it
could break a BSI field's depth even though the import would then
reject it.

always treat BSI fields as having at least their depth:

If you imported only small values, BSI fields could end up
not bothering to clear higher bits in existing values, which
produced strange behaviors.
2019-11-11 16:48:14 -06:00