scriptoriumadmin/featurebase
1
0
Fork 0
mirror of https://github.com/featurebasedb/featurebase.git synced 2026-10-15 15:28:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
No description
8444 commits 45 branches 174 tags 85 MiB
Find a file
Matthew Jaffee 1a8c10d5f3 fix backup fail test so it actually fails 
A few things were going wrong here.

First, we take a "RetryPeriod" option on backup and restore which is
meant to be roughly the total amount of time we spend retrying any
given request before failing. However we were incorrectly passing that
as the RetryMaxWait which is the maximum amount of time to sleep
between any two attempts. We now do some fuzzy math to figure out
approximately how many attempts we should make given a minimum sleep
of 100ms and the fact that we double the sleep time every attempt.

Second, during the backup test, if a host was totally stopped when we
started the request, it would fail immediately and then retry, but if
the host was stopped during the request (after DNS had resolved), then
the request would wait for the DialTimeout which we default to 30s, so
turning off the cluster for 5 seconds and turning it back on resulted
in the backup completing rather than failing. Because of this, we
change the commandClient to have a default dial timeout of 1 second.

I was tempted to change the global default to 1s which I think would
be fine, but didn't want to break anything too badly.
2021-12-28 13:31:42 -06:00
.artifactory Added in various CI files 2021-10-08 12:16:03 -07:00
.circleci add clustertests testing backup's retry 2021-12-21 16:24:20 -06:00
.github remove references to CONTRIBUTING and CHANGELOG 2021-11-19 11:22:15 -06:00
.gitlab Run integration on merge to default branch 2021-12-21 13:58:10 -07:00
api/client add copyright notice back in 2021-12-10 11:01:04 -06:00
authz updated admin to be at the cluster level 2021-12-19 11:37:41 -06:00
boltdb add copyright notice back in 2021-12-10 11:01:04 -06:00
client checksum All() instead of Count(All()) to cover index keys 2021-12-10 11:52:39 -06:00
cmd use retryableHTTP in client, fix memory usage of restore 2021-12-22 10:56:16 -06:00
ctl fix backup fail test so it actually fails 2021-12-28 13:31:42 -06:00
debugstats add copyright notice back in 2021-12-10 11:01:04 -06:00
disco add copyright notice back in 2021-12-10 11:01:04 -06:00
encoding/proto add copyright notice back in 2021-12-10 11:01:04 -06:00
etcd add copyright notice back in 2021-12-10 11:01:04 -06:00
gcnotify add copyright notice back in 2021-12-10 11:01:04 -06:00
generator add copyright notice back in 2021-12-10 11:01:04 -06:00
gopsutil add copyright notice back in 2021-12-10 11:01:04 -06:00
hash add copyright notice back in 2021-12-10 11:01:04 -06:00
http fix backup fail test so it actually fails 2021-12-28 13:31:42 -06:00
ingest add copyright notice back in 2021-12-10 11:01:04 -06:00
ingest_testdata ingest and ingest/codec testing work 2021-08-19 09:50:59 -05:00
install determine permission for user access to index 2021-12-10 14:07:24 -06:00
internal fix backup fail test so it actually fails 2021-12-28 13:31:42 -06:00
lattice remove inline styling 2021-11-04 12:14:01 -05:00
logger add copyright notice back in 2021-12-10 11:01:04 -06:00
lru fix some staticcheck issues 2021-12-03 09:31:45 -06:00
mock add copyright notice back in 2021-12-10 11:01:04 -06:00
net add copyright notice back in 2021-12-10 11:01:04 -06:00
pb add copyright notice back in 2021-12-10 11:01:04 -06:00
pg add copyright notice back in 2021-12-10 11:01:04 -06:00
pql add copyright notice back in 2021-12-10 11:01:04 -06:00
prometheus add copyright notice back in 2021-12-10 11:01:04 -06:00
proto add copyright notice back in 2021-12-10 11:01:04 -06:00
qa add copyright notice back in 2021-12-10 11:01:04 -06:00
rbf Add /debug/rbf endpoint for debugging 2021-12-27 09:34:43 -07:00
roaring add copyright notice back in 2021-12-10 11:01:04 -06:00
scripts Fix benchmark file naming 2021-05-21 14:51:08 -06:00
server Merge branch 'master' into fb1000 2021-12-19 11:38:08 -06:00
shardwidth add copyright notice back in 2021-12-10 11:01:04 -06:00
short_txkey add copyright notice back in 2021-12-10 11:01:04 -06:00
sql add copyright notice back in 2021-12-10 11:01:04 -06:00
sql2 add copyright notice back in 2021-12-10 11:01:04 -06:00
statik add copyright notice back in 2021-12-10 11:01:04 -06:00
stats add copyright notice back in 2021-12-10 11:01:04 -06:00
statsd add copyright notice back in 2021-12-10 11:01:04 -06:00
storage add copyright notice back in 2021-12-10 11:01:04 -06:00
syswrap add copyright notice back in 2021-12-10 11:01:04 -06:00
test add copyright notice back in 2021-12-10 11:01:04 -06:00
testdata Test cases for Store(Distinct) 2020-09-14 14:15:29 -05:00
testhook add copyright notice back in 2021-12-10 11:01:04 -06:00
toml add copyright notice back in 2021-12-10 11:01:04 -06:00
topology add copyright notice back in 2021-12-10 11:01:04 -06:00
tracing add copyright notice back in 2021-12-10 11:01:04 -06:00
txkey add copyright notice back in 2021-12-10 11:01:04 -06:00
vprint add copyright notice back in 2021-12-10 11:01:04 -06:00
.dockerignore Add new Docker build process and continuous delivery 2021-02-26 14:34:14 -06:00
.gitignore add featurebase to .gitignore 2021-10-26 09:15:44 -05:00
.golangci.yml fix govet and gofmt errors in existing code 2021-10-29 13:14:27 -05:00
api.go Add /debug/rbf endpoint for debugging 2021-12-27 09:34:43 -07:00
api_test.go Add /debug/rbf endpoint for debugging 2021-12-27 09:34:43 -07:00
apimethod_string.go remove attributes 2021-05-14 10:28:08 -04:00
audit.go add copyright notice back in 2021-12-10 11:01:04 -06:00
audit_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
audit_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
broadcast.go add copyright notice back in 2021-12-10 11:01:04 -06:00
bsi.go add copyright notice back in 2021-12-10 11:01:04 -06:00
bsi_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
cache.go add copyright notice back in 2021-12-10 11:01:04 -06:00
cache_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
catcher.go add copyright notice back in 2021-12-10 11:01:04 -06:00
client.go use retryableHTTP in client, fix memory usage of restore 2021-12-22 10:56:16 -06:00
cluster.go add copyright notice back in 2021-12-10 11:01:04 -06:00
cluster_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
cmd.go add copyright notice back in 2021-12-10 11:01:04 -06:00
const_amd64.go add copyright notice back in 2021-12-10 11:01:04 -06:00
const_other.go add copyright notice back in 2021-12-10 11:01:04 -06:00
dbshard.go add copyright notice back in 2021-12-10 11:01:04 -06:00
dbshard_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
dbshard_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
delete_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
diagnostics.go add copyright notice back in 2021-12-10 11:01:04 -06:00
diagnostics_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
doc.go add copyright notice back in 2021-12-10 11:01:04 -06:00
Dockerfile remove references to LICENSE and checks for it in source files 2021-11-19 10:38:06 -06:00
Dockerfile-clustertests remove references to LICENSE and checks for it in source files 2021-11-19 10:38:06 -06:00
event.go add copyright notice back in 2021-12-10 11:01:04 -06:00
executor.go Add job & worker metrics 2021-12-28 10:01:18 -07:00
executor_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
executor_test.go smaller clusters to take less memory... test-race getting oom killed 2021-12-10 11:52:39 -06:00
field.go slightly better lock protection around bitDepth in view 2021-12-20 15:09:27 -06:00
field_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
field_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
filesystem.go add copyright notice back in 2021-12-10 11:01:04 -06:00
fragment.go slightly better lock protection around bitDepth in view 2021-12-20 15:09:27 -06:00
fragment_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
gc.go add copyright notice back in 2021-12-10 11:01:04 -06:00
gendebug_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
generation.go add copyright notice back in 2021-12-10 11:01:04 -06:00
generation_debug.go add copyright notice back in 2021-12-10 11:01:04 -06:00
generation_nodebug.go add copyright notice back in 2021-12-10 11:01:04 -06:00
generation_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
gid.go database per shard, HolderConfig, rbf bit-wise import speedups. 2020-09-04 13:00:33 -05:00
go.mod add retryability to restore command 2021-12-21 16:24:20 -06:00
go.sum add retryability to restore command 2021-12-21 16:24:20 -06:00
hack.go add copyright notice back in 2021-12-10 11:01:04 -06:00
handler.go add copyright notice back in 2021-12-10 11:01:04 -06:00
holder.go add copyright notice back in 2021-12-10 11:01:04 -06:00
holder_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
holder_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
idalloc.go add copyright notice back in 2021-12-10 11:01:04 -06:00
idalloc_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
index.go add copyright notice back in 2021-12-10 11:01:04 -06:00
index_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
index_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
ingest_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
iterator.go add copyright notice back in 2021-12-10 11:01:04 -06:00
iterator_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
license.exceptions update license header check exceptions 2021-05-14 10:45:46 -04:00
like.go add copyright notice back in 2021-12-10 11:01:04 -06:00
like_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
main_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
Makefile add clustertests testing backup's retry 2021-12-21 16:24:20 -06:00
metrics.go add copyright notice back in 2021-12-10 11:01:04 -06:00
mmap_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
nfpm.yaml FB-904: Add deb/rpm packaging of FeatureBase binary 2021-11-04 10:32:59 -06:00
NOTICE add config files for release 2021-11-19 01:26:18 +03:00
pilosa.go add copyright notice back in 2021-12-10 11:01:04 -06:00
pilosa_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
pilosa_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
planner.go add copyright notice back in 2021-12-10 11:01:04 -06:00
planner_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
pprof.go add copyright notice back in 2021-12-10 11:01:04 -06:00
rbf.go add copyright notice back in 2021-12-10 11:01:04 -06:00
README.md meaningless commit 2021-10-29 11:56:09 -05:00
row.go add copyright notice back in 2021-12-10 11:01:04 -06:00
row_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
rrtx.go add copyright notice back in 2021-12-10 11:01:04 -06:00
rrtx_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
serializer.go add copyright notice back in 2021-12-10 11:01:04 -06:00
server.go Add job & worker metrics 2021-12-28 10:01:18 -07:00
server_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
snapshotqueue.go add copyright notice back in 2021-12-10 11:01:04 -06:00
stattx.go add copyright notice back in 2021-12-10 11:01:04 -06:00
time.go add copyright notice back in 2021-12-10 11:01:04 -06:00
time_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
tournament.sh remove instances of os.Getenv("PILOSA_TXSRC") 2021-01-21 21:18:46 -06:00
tracker.go add copyright notice back in 2021-12-10 11:01:04 -06:00
tracker_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
transaction.go add copyright notice back in 2021-12-10 11:01:04 -06:00
transaction_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
translate.go another data race? fuck 2021-12-10 11:52:39 -06:00
translator_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
tx.go add copyright notice back in 2021-12-10 11:01:04 -06:00
tx_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
tx_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
txfactory.go don't use write Tx even when we're using the expensive logic for write Tx 2021-12-17 17:57:33 -06:00
txfactory_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
util.go add copyright notice back in 2021-12-10 11:01:04 -06:00
util_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
utils_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00
version.go add copyright notice back in 2021-12-10 11:01:04 -06:00
view.go slightly better lock protection around bitDepth in view 2021-12-20 15:09:27 -06:00
view_internal_test.go add copyright notice back in 2021-12-10 11:01:04 -06:00

README.md

FeatureBase, a distributed bitmap index

See our internal documentation, which includes all external documentation, plus many internal-only pages, listed under the "Internal" heading in the main navigation bar.

Follow along with the Sample Project to get a better understanding of FeatureBase's capabilities.