scriptoriumadmin/featurebase
1
0
Fork 0
mirror of https://github.com/featurebasedb/featurebase.git synced 2026-10-11 05:17:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
No description
9411 commits 45 branches 174 tags 85 MiB
Find a file
jonathan.cheng 43f63b93e3
Cloud 940, skip bad row, enable ingest subsequent rows (#2201) 
* first try to skip decodeMessage() error

* force idk to skip a row if there are errors in recordizing

* add comment for removing returning errors from decodemessage()

* added ingest flag SkipBadRows and implementation for skipping Bad Rows (errors that come from recordizer)

* added some comments

* removed comment

* made changes as per discussion with jaffee and walter. i hope this works...

* adding unit tests to check functionality implemented for CLOUD-940

* addressing review comments

* changed a variable name in test file

* removed a variable from ingest test file

* testing sonarcloud failure

* drop spurious second sonar-scanner call

We call sonar-scanner on the IDK data, and then we change
into the IDK directory and try to run it again on the same files,
which don't exist.

* abandon idk change detection for now

the "changes" rule appears not to be good at detecting changes
in some cases. specifically, it appears that you have to be in
an "only:" clause, not a "rules" clause, to trigger the
merge-specific behavior which checks the entire merge branch
instead of the top commit, but that means that if your last
commit doesn't touch IDK, we don't run IDK tests, and I haven't
been able to fix this yet.

So for now, revert the IDK-specific change detection behavior,
which slows CI down but gets us test coverage.

* fix path references

we had three tests all creating idk_coverage.out, then we tried
to grab all files named coverage.out from the testdata directory.

* refactoring tests to avoid duplication

* reverting changes made for local testing

Co-authored-by: CHIN JUNG CHENG <chengcj@CHINs-MacBook-Pro.local>
Co-authored-by: Pranitha-malae <56414132+Pranitha-malae@users.noreply.github.com>
Co-authored-by: Pranitha-malae <pranitha453@gmail.com>
Co-authored-by: Seebs <seebs@molecula.com>
2022-10-06 16:20:35 -05:00
.github remove references to CONTRIBUTING and CHANGELOG 2021-11-19 11:22:15 -06:00
.gitlab abandon idk change detection for now 2022-10-06 11:45:50 -05:00
api/client Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
authn [FB-1621] account for token expiration as float and int (#2188) 2022-08-10 17:26:10 -05:00
authz drop ioutil 2022-09-23 16:56:27 -05:00
boltdb change perms: 0666 -> 0600; 0777 -> 0750 2022-07-21 13:34:46 -05:00
client adding foreignIndex conf opt (#2239) 2022-10-05 09:13:44 -05:00
cmd drop ioutil 2022-09-23 16:56:27 -05:00
ctl drop ioutil 2022-09-23 16:56:27 -05:00
debugstats add copyright notice back in 2021-12-10 11:01:04 -06:00
disco simplify, streamline, and possibly debug embedded etcd 2022-07-21 11:42:35 -05:00
encoding/proto simplify, streamline, and possibly debug embedded etcd 2022-07-21 11:42:35 -05:00
errors added /sql endpoint; implemented SHOW TABLES (#1935) 2022-08-31 13:01:05 -07:00
etcd test for correct state during test startup 2022-10-06 11:45:50 -05:00
gcnotify Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
generator add copyright notice back in 2021-12-10 11:01:04 -06:00
gopsutil Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
hash drop ioutil 2022-09-23 16:56:27 -05:00
idk Cloud 940, skip bad row, enable ingest subsequent rows (#2201) 2022-10-06 16:20:35 -05:00
ingest drop ioutil 2022-09-23 16:56:27 -05:00
ingest_testdata allow ingest API delete to work at all, add test for it 2022-04-01 09:48:51 -05:00
install Change featurebase user home path to /var/lib/featurebase. (#2242) 2022-10-06 08:38:14 -07:00
internal Distinguish between three copies of fakeidp service (#2192) 2022-08-16 09:13:11 -05:00
lattice FB-1663 - fix make build-lattice failing 2022-09-13 14:10:35 -05:00
logger drop ioutil 2022-09-23 16:56:27 -05:00
lru fix some staticcheck issues 2021-12-03 09:31:45 -06:00
mock Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
monitor Add proper version info to sentry logs 2022-06-21 11:03:22 -05:00
net add copyright notice back in 2021-12-10 11:01:04 -06:00
pb drop ioutil 2022-09-23 16:56:27 -05:00
pql drop ioutil 2022-09-23 16:56:27 -05:00
prometheus Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
proto Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
qa improve resilience of smoke test setup 2022-10-06 11:45:50 -05:00
rbf smallify Quick checks 2022-08-25 15:00:48 -05:00
roaring remove a commented-out test case for a function that no longer exists 2022-09-23 16:56:27 -05:00
scripts remove trailing spaces en masse (#2024) 2022-04-18 09:31:35 -05:00
server drop ioutil 2022-09-23 16:56:27 -05:00
shardwidth Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
short_txkey remove a bunch of commented print statements and unecessary prints 2022-01-11 10:42:44 -06:00
sql use testhook test cleanup 2022-09-26 12:33:43 -05:00
sql3 moved file from this repo to documentation repo (#2232) 2022-09-28 14:32:15 -05:00
statik Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
stats use testhook test cleanup 2022-09-26 12:33:43 -05:00
statsd Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
storage remove a bunch of roaring backend stuff 2022-02-02 20:56:18 -06:00
syswrap add copyright notice back in 2021-12-10 11:01:04 -06:00
task implement a task pool 2022-02-14 09:56:19 -06:00
test use testhook test cleanup 2022-09-26 12:33:43 -05:00
testdata refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
testhook drop ioutil 2022-09-23 16:56:27 -05:00
toml add copyright notice back in 2021-12-10 11:01:04 -06:00
tracing Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
txkey remove a bunch of commented print statements and unecessary prints 2022-01-11 10:42:44 -06:00
vprint add copyright notice back in 2021-12-10 11:01:04 -06:00
.dockerignore FB-1597: unifying idk and featurebase (#2160) 2022-07-28 17:23:16 -05:00
.gitignore added /sql endpoint; implemented SHOW TABLES (#1935) 2022-08-31 13:01:05 -07:00
.golangci.yml fix govet and gofmt errors in existing code 2021-10-29 13:14:27 -05:00
api.go drop ioutil 2022-09-23 16:56:27 -05:00
api_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
apimethod_string.go Remove most of the resize-related logic 2022-06-21 17:03:09 -05:00
audit.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
audit_internal_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
audit_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
broadcast.go simplify, streamline, and possibly debug embedded etcd 2022-07-21 11:42:35 -05:00
bsi.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
bsi_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
cache.go comment cleanup 2022-05-27 11:25:17 -05:00
cache_test.go Periodically invalidate rank cache during bulk add 2022-02-15 08:25:45 -07:00
catcher.go create BitmapRewriter/ApplyRewriter, parallel to BitmapFilter 2022-04-12 12:24:22 -05:00
cluster.go address multiple staticcheck issues 2022-09-23 16:56:27 -05:00
cluster_internal_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
cmd.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
CODE_OF_CONDUCT.md chore(community): adds code of conduct (#2195) 2022-08-17 12:30:22 -04:00
const_amd64.go add copyright notice back in 2021-12-10 11:01:04 -06:00
const_other.go add copyright notice back in 2021-12-10 11:01:04 -06:00
dbshard.go drop the bool from a map that's only using it to check presence 2022-06-09 10:26:19 -05:00
dbshard_internal_test.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
dbshard_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
delete_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
diagnostics.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
diagnostics_internal_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
doc.go add copyright notice back in 2021-12-10 11:01:04 -06:00
Dockerfile FB-1663 - fix make build-lattice failing 2022-09-13 14:10:35 -05:00
Dockerfile-clustertests Upgrade Go to 1.19 (#2204) 2022-08-25 14:54:14 -06:00
Dockerfile-clustertests-client Upgrade Go to 1.19 (#2204) 2022-08-25 14:54:14 -06:00
event.go simplify, streamline, and possibly debug embedded etcd 2022-07-21 11:42:35 -05:00
executor.go address multiple staticcheck issues 2022-09-23 16:56:27 -05:00
executor_internal_test.go address multiple staticcheck issues 2022-09-23 16:56:27 -05:00
executor_test.go address multiple staticcheck issues 2022-09-23 16:56:27 -05:00
field.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
field_internal_test.go address multiple staticcheck issues 2022-09-23 16:56:27 -05:00
field_test.go address multiple staticcheck issues 2022-09-23 16:56:27 -05:00
filesystem.go add copyright notice back in 2021-12-10 11:01:04 -06:00
fragment.go drop unused row 2022-09-23 16:56:27 -05:00
fragment_internal_test.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
gc.go add copyright notice back in 2021-12-10 11:01:04 -06:00
gid.go database per shard, HolderConfig, rbf bit-wise import speedups. 2020-09-04 13:00:33 -05:00
go.mod Fix UUID library version for CVE-2021-3538 (#2213) 2022-09-06 13:52:13 -06:00
go.sum Fix UUID library version for CVE-2021-3538 (#2213) 2022-09-06 13:52:13 -06:00
hack.go Change Ttl to TTL (#2038) 2022-04-27 11:20:39 -05:00
handler.go add doc comments 2022-05-27 11:25:17 -05:00
holder.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
holder_internal_test.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
holder_test.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
http_handler.go And now....INNER JOIN! (#2230) 2022-09-27 09:27:37 -05:00
http_handler_internal_test.go drop ioutil 2022-09-23 16:56:27 -05:00
http_handler_test.go address multiple staticcheck issues 2022-09-23 16:56:27 -05:00
http_translator.go drop ioutil 2022-09-23 16:56:27 -05:00
http_translator_test.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
idalloc.go change perms: 0666 -> 0600; 0777 -> 0750 2022-07-21 13:34:46 -05:00
idalloc_test.go change perms: 0666 -> 0600; 0777 -> 0750 2022-07-21 13:34:46 -05:00
index.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
index_internal_test.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
index_test.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
ingest_test.go drop ioutil 2022-09-23 16:56:27 -05:00
internal_client.go drop ioutil 2022-09-23 16:56:27 -05:00
internal_client_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
iterator.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
iterator_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
license.exceptions update license header check exceptions 2021-05-14 10:45:46 -04:00
like.go add copyright notice back in 2021-12-10 11:01:04 -06:00
like_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
main_test.go use testhook test cleanup 2022-09-26 12:33:43 -05:00
Makefile drop test timeouts to reasonable values 2022-10-03 10:28:22 -05:00
metrics.go add copyright notice back in 2021-12-10 11:01:04 -06:00
nfpm.yaml Fixed broken fields when packaging rpm and deb files. (#2153) 2022-07-27 12:54:46 -05:00
NOTICE add config files for release 2021-11-19 01:26:18 +03:00
pilosa.go Remove most of the resize-related logic 2022-06-21 17:03:09 -05:00
pilosa_internal_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
pilosa_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
pprof.go remove a bunch of roaring backend stuff 2022-02-02 20:56:18 -06:00
rbf.go address multiple staticcheck issues 2022-09-23 16:56:27 -05:00
README.md chore(community): adds code of conduct (#2195) 2022-08-17 12:30:22 -04:00
row.go remove string keys on delete to allow for reuse 2022-02-25 16:23:54 -06:00
row_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
serializer.go add copyright notice back in 2021-12-10 11:01:04 -06:00
server.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
server_internal_test.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
server_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
stattx.go create BitmapRewriter/ApplyRewriter, parallel to BitmapFilter 2022-04-12 12:24:22 -05:00
time.go FB-1456 - TTL - fixed views not returning correct results (#2062) 2022-05-16 15:26:13 -05:00
time_internal_test.go FB-1456 - TTL - fixed views not returning correct results (#2062) 2022-05-16 15:26:13 -05:00
tracker.go add copyright notice back in 2021-12-10 11:01:04 -06:00
tracker_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
transaction.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
transaction_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
translate.go drop ioutil 2022-09-23 16:56:27 -05:00
translator_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
tx.go create BitmapRewriter/ApplyRewriter, parallel to BitmapFilter 2022-04-12 12:24:22 -05:00
tx_internal_test.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
tx_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
txfactory.go address multiple staticcheck issues 2022-09-23 16:56:27 -05:00
txfactory_internal_test.go remove a bunch of roaring backend stuff 2022-02-02 20:56:18 -06:00
util.go continue removing Tx parameters to view-type functions 2022-09-23 16:56:27 -05:00
util_test.go [FB-1024 FB-1590] Increase timerange (un-revert) (#2174) 2022-08-04 15:20:45 -07:00
utils_internal_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
version.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
view.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
view_internal_test.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00

README.md

FeatureBase, a distributed bitmap index

Contributor Covenant Coverage SecurityRating Quality Gate Status

See our internal documentation, which includes all external documentation, plus many internal-only pages, listed under the "Internal" heading in the main navigation bar.

Follow along with the Sample Project to get a better understanding of FeatureBase's capabilities.