scriptoriumadmin/featurebase
1
0
Fork 0
mirror of https://github.com/featurebasedb/featurebase.git synced 2026-08-28 10:54:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
No description
9515 commits 45 branches 174 tags 85 MiB
Find a file
Lory Cloutier a8996a149d
Prevent file corruption when writing tar backup to stdout (#2344) 
* Prevent file corruption when writing tar backup to stdout

FB-1794

Tar backups written to stdout were coming out corrupt. This turned
out to be due to log messages getting written to stdout and ending
up in the tar file. We now check to see if the tar file and the log
are both going to stdout, and if they are, send the logs to stderr
instead.

Testing did not have any kind of consistency or validity check. We
now compare a tar file sent to a file and a tar file sent to stdout
to make sure they're the same. This does not guarantee correctness
but does at least catch this form of corruption.

* trying different index name

Co-authored-by: tgruben <tgruben@gmail.com>
Co-authored-by: Todd Gruben <todd@molecula.com>
2022-12-13 13:03:16 -06:00
.github remove references to CONTRIBUTING and CHANGELOG 2021-11-19 11:22:15 -06:00
.gitlab Introduce ServiceManager and Refactor DAX Integration tests (#2320) 2022-12-05 14:49:17 -06:00
api/client enable staticcheck in ci; remove dead code (#2281) 2022-11-07 13:45:19 -06:00
authn Dataframe (#2241) 2022-11-21 17:38:48 -06:00
authz staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
batch Remove trackExistence check in batch (i.e. always build _exists) data. (#2348) 2022-12-09 17:30:10 -06:00
boltdb staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
client Fb 1874 dataframe-csv-loader featurebase subcommand (#2341) 2022-12-12 15:13:58 -06:00
cmd Prevent file corruption when writing tar backup to stdout (#2344) 2022-12-13 13:03:16 -06:00
context implement fb_exec_requests system table (#2327) 2022-12-02 16:42:45 -06:00
ctl Prevent file corruption when writing tar backup to stdout (#2344) 2022-12-13 13:03:16 -06:00
dax Fix dax docker-compose (dc-up) which was broken by ServiceManager (#2356) 2022-12-12 15:42:57 -06:00
debugstats add copyright notice back in 2021-12-10 11:01:04 -06:00
disco Introduce ServiceManager and Refactor DAX Integration tests (#2320) 2022-12-05 14:49:17 -06:00
encoding/proto [FB-1776] support for marshaling ExtractedIDMatrixSorted (#2319) 2022-11-30 13:47:26 -06:00
errors Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
etcd enforce int min/max constraints on insert (fb-1772) (#2325) 2022-12-05 22:51:42 -06:00
fbcloud Fix formatting in CLI results with custom SQLResonse.UnmarshalJSON (#2305) 2022-11-21 18:43:53 -06:00
gcnotify Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
generator add copyright notice back in 2021-12-10 11:01:04 -06:00
gopsutil Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
hash drop ioutil 2022-09-23 16:56:27 -05:00
idk Make interfaces more specific than "MDS" (#2352) 2022-12-12 13:14:17 -06:00
install Packaging improvements to improve mcloud updates (#2288) 2022-11-10 11:13:06 -08:00
internal FB-1766: cleaning up the CmdIO objects passing alternate stdin/ 2022-11-29 12:49:36 -06:00
lattice This adds in support to the lattice UI application to use the SQL3 (#2338) 2022-12-08 12:47:21 -08:00
logger Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
lru fix some staticcheck issues 2021-12-03 09:31:45 -06:00
mock Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
monitor Add proper version info to sentry logs 2022-06-21 11:03:22 -05:00
net staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
pb [FB-1776] support for marshaling ExtractedIDMatrixSorted (#2319) 2022-11-30 13:47:26 -06:00
pql non-sql aggregation, top, decimal and sundries (#2328) 2022-12-03 20:39:57 -06:00
prometheus Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
proto fb-1729 Enriched Table Metadata (#2255) 2022-10-26 11:23:40 -05:00
qa Rename some interfaces. Remove the ComputeAPI (#2333) 2022-12-07 09:02:39 -06:00
querycontext bump timeout on overlapping write requests test 2022-11-15 13:31:37 -06:00
rbf upgrade to immutable 0.4.0(generics) (#2317) 2022-11-28 12:12:03 -06:00
roaring staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
scripts remove trailing spaces en masse (#2024) 2022-04-18 09:31:35 -05:00
server Move batch.Importer interface to pilosa.Importer (#2347) 2022-12-09 14:24:47 -06:00
shardwidth Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
short_txkey staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
sql staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
sql3 fixed csv bugs (#2355) 2022-12-12 17:14:10 -06:00
statik staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
stats use testhook test cleanup 2022-09-26 12:33:43 -05:00
statsd Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
storage remove a bunch of roaring backend stuff 2022-02-02 20:56:18 -06:00
systemlayer implement fb_exec_requests system table (#2327) 2022-12-02 16:42:45 -06:00
syswrap add copyright notice back in 2021-12-10 11:01:04 -06:00
task implement a task pool 2022-02-14 09:56:19 -06:00
test FB-1766: cleaning up the CmdIO objects passing alternate stdin/ 2022-11-29 12:49:36 -06:00
testdata refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
testhook drop ioutil 2022-09-23 16:56:27 -05:00
toml add copyright notice back in 2021-12-10 11:01:04 -06:00
tracing Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
txkey staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
vprint add copyright notice back in 2021-12-10 11:01:04 -06:00
.dockerignore FB-1597: unifying idk and featurebase (#2160) 2022-07-28 17:23:16 -05:00
.gitignore Dataframe (#2241) 2022-11-21 17:38:48 -06:00
.golangci.yml enable staticcheck in ci; remove dead code (#2281) 2022-11-07 13:45:19 -06:00
api.go Make interfaces more specific than "MDS" (#2352) 2022-12-12 13:14:17 -06:00
api_directive.go Convert SchemaAPI interface to use dax.Table instead of pilosa.IndexInfo (#2336) 2022-12-08 11:35:17 -06:00
api_directive_internal_test.go Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
api_directive_test.go Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
api_test.go Don't use reflect.DeepEqual to compare errors. 2022-11-30 14:47:39 -06:00
apimethod_string.go Drop the ingest subpackage and related endpoints. 2022-11-01 13:08:44 -05:00
apply.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
arrow.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
audit.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
audit_internal_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
audit_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
broadcast.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
bsi.go Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
bsi_test.go Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
cache.go comment cleanup 2022-05-27 11:25:17 -05:00
cache_test.go Periodically invalidate rank cache during bulk add 2022-02-15 08:25:45 -07:00
catcher.go Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
cluster.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
cluster_internal_test.go drop anti-entropy feature, since it doesn't work 2022-11-04 14:08:23 -05:00
CODE_OF_CONDUCT.md chore(community): adds code of conduct (#2195) 2022-08-17 12:30:22 -04:00
const_amd64.go add copyright notice back in 2021-12-10 11:01:04 -06:00
const_other.go add copyright notice back in 2021-12-10 11:01:04 -06:00
dataframe_test.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
dbshard.go staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
dbshard_internal_test.go fb-1729 Enriched Table Metadata (#2255) 2022-10-26 11:23:40 -05:00
dbshard_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
delete_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
diagnostics.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
diagnostics_internal_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
doc.go add copyright notice back in 2021-12-10 11:01:04 -06:00
Dockerfile Make SOURCE_DATE_EPOCH changes for idk 2022-12-02 09:48:12 -07:00
Dockerfile-clustertests Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
Dockerfile-clustertests-client Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
Dockerfile-datagen Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
Dockerfile-dax Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
Dockerfile-dax-quick Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
et_test.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
event.go simplify, streamline, and possibly debug embedded etcd 2022-07-21 11:42:35 -05:00
executor.go Introduce TableKeyer interface; use in Execute() calls as "index" (#2350) 2022-12-11 11:45:10 -06:00
executor_internal_test.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
executor_test.go Don't use reflect.DeepEqual to compare errors. 2022-11-30 14:47:39 -06:00
field.go fb-1729 Enriched Table Metadata (#2255) 2022-10-26 11:23:40 -05:00
field_internal_test.go address multiple staticcheck issues 2022-09-23 16:56:27 -05:00
field_test.go fb-1729 Enriched Table Metadata (#2255) 2022-10-26 11:23:40 -05:00
filesystem.go add copyright notice back in 2021-12-10 11:01:04 -06:00
fragment.go Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
fragment_internal_test.go drop anti-entropy feature, since it doesn't work 2022-11-04 14:08:23 -05:00
gc.go add copyright notice back in 2021-12-10 11:01:04 -06:00
gid.go database per shard, HolderConfig, rbf bit-wise import speedups. 2020-09-04 13:00:33 -05:00
go.mod Introduce ServiceManager and Refactor DAX Integration tests (#2320) 2022-12-05 14:49:17 -06:00
go.sum Introduce ServiceManager and Refactor DAX Integration tests (#2320) 2022-12-05 14:49:17 -06:00
hack.go Change Ttl to TTL (#2038) 2022-04-27 11:20:39 -05:00
handler.go Don't use reflect.DeepEqual to compare errors. 2022-11-30 14:47:39 -06:00
handler_test.go Don't use reflect.DeepEqual to compare errors. 2022-11-30 14:47:39 -06:00
holder.go Introduce ServiceManager and Refactor DAX Integration tests (#2320) 2022-12-05 14:49:17 -06:00
holder_internal_test.go fb-1729 Enriched Table Metadata (#2255) 2022-10-26 11:23:40 -05:00
holder_test.go drop anti-entropy feature, since it doesn't work 2022-11-04 14:08:23 -05:00
http_handler.go implemented extract ddl; tightened up type related stuff (#2329) 2022-12-05 16:50:30 -06:00
http_handler_internal_test.go drop ioutil 2022-09-23 16:56:27 -05:00
http_handler_test.go Drop the ingest subpackage and related endpoints. 2022-11-01 13:08:44 -05:00
http_translator.go drop ioutil 2022-09-23 16:56:27 -05:00
http_translator_test.go fb-1729 Enriched Table Metadata (#2255) 2022-10-26 11:23:40 -05:00
idalloc.go change perms: 0666 -> 0600; 0777 -> 0750 2022-07-21 13:34:46 -05:00
idalloc_test.go change perms: 0666 -> 0600; 0777 -> 0750 2022-07-21 13:34:46 -05:00
importer.go Remove trackExistence check in batch (i.e. always build _exists) data. (#2348) 2022-12-09 17:30:10 -06:00
index.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
index_internal_test.go fb-1729 Enriched Table Metadata (#2255) 2022-10-26 11:23:40 -05:00
index_test.go fb-1729 Enriched Table Metadata (#2255) 2022-10-26 11:23:40 -05:00
internal_client.go Introduce ServiceManager and Refactor DAX Integration tests (#2320) 2022-12-05 14:49:17 -06:00
internal_client_test.go implement fb_exec_requests system table (#2327) 2022-12-02 16:42:45 -06:00
iterator.go drop anti-entropy feature, since it doesn't work 2022-11-04 14:08:23 -05:00
iterator_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
license.exceptions update license header check exceptions 2021-05-14 10:45:46 -04:00
like.go add copyright notice back in 2021-12-10 11:01:04 -06:00
like_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
main_test.go use testhook test cleanup 2022-09-26 12:33:43 -05:00
Makefile Make SOURCE_DATE_EPOCH changes for idk 2022-12-02 09:48:12 -07:00
metrics.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
nfpm.yaml Packaging improvements to improve mcloud updates (#2288) 2022-11-10 11:13:06 -08:00
NOTICE add config files for release 2021-11-19 01:26:18 +03:00
pilosa.go Remove most of the resize-related logic 2022-06-21 17:03:09 -05:00
pilosa_internal_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
pilosa_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
pprof.go remove a bunch of roaring backend stuff 2022-02-02 20:56:18 -06:00
rbf.go drop anti-entropy feature, since it doesn't work 2022-11-04 14:08:23 -05:00
README.md chore(community): adds code of conduct (#2195) 2022-08-17 12:30:22 -04:00
row.go Dataframe (#2241) 2022-11-21 17:38:48 -06:00
row_test.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
schema.go Thread Owner, UpdatedAt, UpdatedBy through SchemaAPI (#2351) 2022-12-12 12:36:37 -06:00
serializer.go add copyright notice back in 2021-12-10 11:01:04 -06:00
server.go Introduce ServiceManager and Refactor DAX Integration tests (#2320) 2022-12-05 14:49:17 -06:00
server_internal_test.go drop anti-entropy feature, since it doesn't work 2022-11-04 14:08:23 -05:00
server_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
sql_test.go Fix formatting in CLI results with custom SQLResonse.UnmarshalJSON (#2305) 2022-11-21 18:43:53 -06:00
stattx.go drop anti-entropy feature, since it doesn't work 2022-11-04 14:08:23 -05:00
systemlayer.go implement fb_exec_requests system table (#2327) 2022-12-02 16:42:45 -06:00
time.go staticcheck fixes (#2278) 2022-11-07 10:51:55 -06:00
time_internal_test.go FB-1456 - TTL - fixed views not returning correct results (#2062) 2022-05-16 15:26:13 -05:00
tracker.go add copyright notice back in 2021-12-10 11:01:04 -06:00
tracker_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
transaction.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
transaction_test.go Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
translate.go Drop the ingest subpackage and related endpoints. 2022-11-01 13:08:44 -05:00
translator_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
tx.go drop anti-entropy feature, since it doesn't work 2022-11-04 14:08:23 -05:00
tx_internal_test.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
tx_test.go use t.Fatal(f) to abort tests, not panic 2022-10-14 09:49:19 -05:00
txfactory.go Add DAX - full list of squashed commits below 2022-11-16 11:19:40 -06:00
txfactory_internal_test.go remove a bunch of roaring backend stuff 2022-02-02 20:56:18 -06:00
util.go continue removing Tx parameters to view-type functions 2022-09-23 16:56:27 -05:00
util_test.go [FB-1024 FB-1590] Increase timerange (un-revert) (#2174) 2022-08-04 15:20:45 -07:00
utils_internal_test.go refactor testing to share clusters more often 2022-09-02 11:40:37 -05:00
version.go Upgrade go.mod to featurebase/v3 2022-01-21 10:57:05 -07:00
view.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
view_internal_test.go significant refactor of test setup and teardown 2022-09-23 16:56:27 -05:00
wire_response.go Fix more of the SQL tests in dax (#2310) 2022-11-22 15:51:41 -06:00

README.md

FeatureBase, a distributed bitmap index

Contributor Covenant Coverage SecurityRating Quality Gate Status

See our internal documentation, which includes all external documentation, plus many internal-only pages, listed under the "Internal" heading in the main navigation bar.

Follow along with the Sample Project to get a better understanding of FeatureBase's capabilities.