No description
Find a file
Seebs cf97a0dcb8 overhaul: switch over to using QueryContext
We switch everything to use QueryContext/QueryRead/etc instead
of Qcx/Tx.

We drop the short_txkey subpackage (it's now handled by either
keys or querycontext).

We drop all the dbshard stuff, and all the tx/txfactory stuff.

We remove all the things that related to the old "Block" concept,
which was mostly used by the anti-entropy code, but had one
fragmentary usage left in the ImportRoaringOverwrite case of
ImportRoaring. That's replaced by using a rewriter that deletes
all bits (not just bits in specific columns) from an existing
thing, but writes in new bits. Actually we could probably do that
better with a custom "eradicate-rewriter" that doesn't try to
be clever, and just eliminates things.

This includes a number of minor bug fixes that were
exposed by getting the testing to work. For example:
* When checking whether an operation "requires write", we
  now consider a Delete a kind of a Write, because it is.
* Several tests were relying on the fact that writes through
  Qcx were being committed whether or not the Qcx was ever
  told to finish. With QueryContext, you actually have to
  reach a Commit() or the writes don't happen (except for
  special cases in Delete).
* Replaced a lot of panics with t.Fatalf in tests.

There's also some minor staticcheck fixes, like deleting the
unused "db" member of a boltdb transaction wrapper.
2023-01-11 12:57:56 -06:00
.github remove references to CONTRIBUTING and CHANGELOG 2021-11-19 11:22:15 -06:00
.gitlab dax/test/dax need an image now that they're running under Docker 2022-12-21 07:42:04 -06:00
api/client enable staticcheck in ci; remove dead code (#2281) 2022-11-07 13:45:19 -06:00
authn Dataframe (#2241) 2022-11-21 17:38:48 -06:00
authz staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
batch [FB-1831] distribute bulk insert to owning node (#2391) 2023-01-04 14:26:08 -06:00
bufferpool implemented DISTINCT (fb-1562) (#2388) 2023-01-03 22:13:31 -06:00
client Fb 1874 dataframe-csv-loader featurebase subcommand (#2341) 2022-12-12 15:13:58 -06:00
cmd drop no-longer-relevant roaring-migrate 2023-01-11 12:52:03 -06:00
context implement fb_exec_requests system table (#2327) 2022-12-02 16:42:45 -06:00
ctl overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
dax overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
debugstats add copyright notice back in 2021-12-10 11:01:04 -06:00
disco Introduce ServiceManager and Refactor DAX Integration tests (#2320) 2022-12-05 14:49:17 -06:00
encoding/proto overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
errors Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
etcd enforce int min/max constraints on insert (fb-1772) (#2325) 2022-12-05 22:51:42 -06:00
extendiblehash implemented DISTINCT (fb-1562) (#2388) 2023-01-03 22:13:31 -06:00
fbcloud Small adjustments to support the Serverless cloud merge (#2385) 2022-12-22 12:22:09 -06:00
gcnotify Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
generator add copyright notice back in 2021-12-10 11:01:04 -06:00
gopsutil Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
hash drop ioutil 2022-09-23 16:56:27 -05:00
idk Expose translation mvcc (#2381) 2022-12-20 07:45:32 -06:00
install Packaging improvements to improve mcloud updates (#2288) 2022-11-10 11:13:06 -08:00
internal remove in mem translate store 2022-12-17 13:10:46 -06:00
keys create keys package to unify types of index/field/view/shard keys 2023-01-11 12:52:03 -06:00
lattice This fixes a bug with displaying errors returned from the SQL3 endpoint (#2374) 2022-12-16 08:22:27 -08:00
logger Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
lru fix some staticcheck issues 2021-12-03 09:31:45 -06:00
mock Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
monitor Add proper version info to sentry logs 2022-06-21 11:03:22 -05:00
net staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
pb [FB-1776] support for marshaling ExtractedIDMatrixSorted (#2319) 2022-11-30 13:47:26 -06:00
pql overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
prometheus Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
proto fb-1729 Enriched Table Metadata (#2255) 2022-10-26 11:23:40 -05:00
qa Remove manual jobs from CI 2022-12-14 11:30:39 -07:00
querycontext querycontext updates/changes to support the big changeover 2023-01-11 12:52:04 -06:00
rbf overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
roaring overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
scripts remove trailing spaces en masse (#2024) 2022-04-18 09:31:35 -05:00
server overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
shardwidth Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
sql staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
sql3 FB-1814: Implement ASCII() (#2378) 2023-01-11 12:32:27 -05:00
statik staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
stats use testhook test cleanup 2022-09-26 12:33:43 -05:00
statsd Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
storage remove a bunch of roaring backend stuff 2022-02-02 20:56:18 -06:00
systemlayer implement fb_exec_requests system table (#2327) 2022-12-02 16:42:45 -06:00
syswrap add copyright notice back in 2021-12-10 11:01:04 -06:00
task implement a task pool 2022-02-14 09:56:19 -06:00
test overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
testdata refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
testhook drop ioutil 2022-09-23 16:56:27 -05:00
toml add copyright notice back in 2021-12-10 11:01:04 -06:00
tracing Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
vprint add copyright notice back in 2021-12-10 11:01:04 -06:00
.dockerignore FB-1597: unifying idk and featurebase (#2160) 2022-07-28 17:23:16 -05:00
.gitignore Dataframe (#2241) 2022-11-21 17:38:48 -06:00
.golangci.yml enable staticcheck in ci; remove dead code (#2281) 2022-11-07 13:45:19 -06:00
api.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
api_directive.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
api_directive_internal_test.go Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
api_directive_test.go Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
api_test.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
apimethod_string.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
apply.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
arrow.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
arrow_test.go [FB-1822] Change dataframe disk format to Arrow from parquet (#2376) 2022-12-16 14:42:39 -06:00
audit.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
audit_internal_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
audit_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
broadcast.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
bsi.go Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
bsi_test.go Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
cache.go comment cleanup 2022-05-27 11:25:17 -05:00
cache_test.go Periodically invalidate rank cache during bulk add 2022-02-15 08:25:45 -07:00
cluster.go first cut at removing all the shard/field/partition versioning 2023-01-03 15:31:32 -06:00
cluster_internal_test.go drop anti-entropy feature, since it doesn't work 2022-11-04 14:08:23 -05:00
CODE_OF_CONDUCT.md chore(community): adds code of conduct (#2195) 2022-08-17 12:30:22 -04:00
const_amd64.go add copyright notice back in 2021-12-10 11:01:04 -06:00
const_other.go add copyright notice back in 2021-12-10 11:01:04 -06:00
dataframe_test.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
delete_test.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
diagnostics.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
diagnostics_internal_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
doc.go add copyright notice back in 2021-12-10 11:01:04 -06:00
Dockerfile Make SOURCE_DATE_EPOCH changes for idk 2022-12-02 09:48:12 -07:00
Dockerfile-clustertests Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
Dockerfile-clustertests-client Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
Dockerfile-datagen Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
Dockerfile-dax Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
Dockerfile-dax-quick Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
et_test.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
event.go simplify, streamline, and possibly debug embedded etcd 2022-07-21 11:42:35 -05:00
executor.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
executor_internal_test.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
executor_test.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
field.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
field_internal_test.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
field_test.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
filesystem.go add copyright notice back in 2021-12-10 11:01:04 -06:00
fragment.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
fragment_internal_test.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
gc.go add copyright notice back in 2021-12-10 11:01:04 -06:00
gid.go database per shard, HolderConfig, rbf bit-wise import speedups. 2020-09-04 13:00:33 -05:00
go.mod Add dd tracer and associated config options (#2403) 2023-01-10 14:06:09 -08:00
go.sum Add dd tracer and associated config options (#2403) 2023-01-10 14:06:09 -08:00
hack.go Change Ttl to TTL (#2038) 2022-04-27 11:20:39 -05:00
handler.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
handler_test.go Don't use reflect.DeepEqual to compare errors. 2022-11-30 14:47:39 -06:00
holder.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
holder_internal_test.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
holder_test.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
http_handler.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
http_handler_internal_test.go drop ioutil 2022-09-23 16:56:27 -05:00
http_handler_test.go Change JSON tag name on WireQueryResponse from execution-time to exec_time (#2394) 2023-01-05 18:34:01 -06:00
http_translator.go drop ioutil 2022-09-23 16:56:27 -05:00
http_translator_test.go fb-1729 Enriched Table Metadata (#2255) 2022-10-26 11:23:40 -05:00
idalloc.go change perms: 0666 -> 0600; 0777 -> 0750 2022-07-21 13:34:46 -05:00
idalloc_test.go change perms: 0666 -> 0600; 0777 -> 0750 2022-07-21 13:34:46 -05:00
importer.go [FB-1831] distribute bulk insert to owning node (#2391) 2023-01-04 14:26:08 -06:00
index.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
index_test.go fb-1729 Enriched Table Metadata (#2255) 2022-10-26 11:23:40 -05:00
internal_client.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
internal_client_test.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
iterator.go drop anti-entropy feature, since it doesn't work 2022-11-04 14:08:23 -05:00
iterator_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
license.exceptions update license header check exceptions 2021-05-14 10:45:46 -04:00
like.go add copyright notice back in 2021-12-10 11:01:04 -06:00
like_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
main_test.go use testhook test cleanup 2022-09-26 12:33:43 -05:00
Makefile Small adjustments to support the Serverless cloud merge (#2385) 2022-12-22 12:22:09 -06:00
metrics.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
nfpm.yaml Packaging improvements to improve mcloud updates (#2288) 2022-11-10 11:13:06 -08:00
NOTICE add config files for release 2021-11-19 01:26:18 +03:00
pilosa.go Remove most of the resize-related logic 2022-06-21 17:03:09 -05:00
pilosa_internal_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
pilosa_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
pprof.go remove a bunch of roaring backend stuff 2022-02-02 20:56:18 -06:00
README.md chore(community): adds code of conduct (#2195) 2022-08-17 12:30:22 -04:00
row.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
row_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
schema.go Thread Owner, UpdatedAt, UpdatedBy through SchemaAPI (#2351) 2022-12-12 12:36:37 -06:00
serializer.go add copyright notice back in 2021-12-10 11:01:04 -06:00
server.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
server_internal_test.go drop anti-entropy feature, since it doesn't work 2022-11-04 14:08:23 -05:00
server_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
sql_test.go Fix formatting in CLI results with custom SQLResonse.UnmarshalJSON (#2305) 2022-11-21 18:43:53 -06:00
systemlayer.go implement fb_exec_requests system table (#2327) 2022-12-02 16:42:45 -06:00
time.go staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
time_internal_test.go FB-1456 - TTL - fixed views not returning correct results (#2062) 2022-05-16 15:26:13 -05:00
tracker.go add copyright notice back in 2021-12-10 11:01:04 -06:00
tracker_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
transaction.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
transaction_test.go Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
translate.go Expose translation mvcc (#2381) 2022-12-20 07:45:32 -06:00
translate_boltdb.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
translate_boltdb_internal_test.go remove in mem translate store 2022-12-17 13:10:46 -06:00
translate_boltdb_test.go Expose translation mvcc (#2381) 2022-12-20 07:45:32 -06:00
translator_test.go remove in mem translate store 2022-12-17 13:10:46 -06:00
util.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
util_test.go [FB-1024 FB-1590] Increase timerange (un-revert) (#2174) 2022-08-04 15:20:45 -07:00
utils_internal_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
version.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
view.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
view_internal_test.go overhaul: switch over to using QueryContext 2023-01-11 12:57:56 -06:00
wire_response.go Fix more of the SQL tests in dax (#2310) 2022-11-22 15:51:41 -06:00

FeatureBase, a distributed bitmap index

Contributor Covenant Coverage SecurityRating Quality Gate Status

See our internal documentation, which includes all external documentation, plus many internal-only pages, listed under the "Internal" heading in the main navigation bar.

Follow along with the Sample Project to get a better understanding of FeatureBase's capabilities.