Seebs
5c889c72bd
make test hit the lock harder
...
Discovered test was running slightly strange and spending an unreasonable
amount of time on rand.Intn(), possibly because we weren't caching the
value used as the loop condition. Tweaked that, also made the pool a
bit different. Now it takes ~50 seconds for benchtime 100x, and produces
a profile with a TON of time spent waiting on sleeps (expected) and
the condition variable for waiting on checkpoints (the thing we want
to measure, really).
2021-12-17 15:09:25 -06:00
Seebs
3ed4487ae2
scratch space for FB-992: create benchmark for checkpointing
...
Note also the commented-out debug printf in checkpoint, there as a
reference. This is interesting because it turns out that MOST of checkpoint
writes is not actually writing new pages in most cases.
The actual "pages in WAL : pages in map" ratio is typically around 30:1
apparently. This would likely be different in cases where we were
updating existing data, though.
This is scratch space to prep for an actual work. The final
results will likely be different.
2021-12-17 15:09:25 -06:00
reese
65ab92f364
Merge pull request #1811 from molecula/fb-1027
...
[fb-1027] ensure field bit depth is set when restoring shard
2021-12-16 08:54:34 -06:00
reesporte
c59ce837b3
ensure field bit depth is set when restoring shard
...
we have to manually set the cache value here bc it wont get set until the node is restarted otherwise
2021-12-15 16:09:45 -06:00
Matthew Jaffee
600494c724
Merge pull request #1810 from molecula/sup-126
...
[SUP-126] Defer unlock & rollback during rbf.DB.Begin()
2021-12-15 08:39:24 -06:00
Ben Johnson
7141662c03
Defer unlock & rollback during rbf.DB.Begin()
2021-12-15 07:16:30 -07:00
tgruben
a52eda0510
Merge pull request #1808 from molecula/sup120
...
[SUP-120] use higher level iterator in order to account for ops log
2021-12-13 13:51:29 -06:00
Todd Gruben
c25ab78b03
use higherlevel iterator in order to account for ops log
2021-12-13 13:10:16 -06:00
Matthew Jaffee
9283d52141
Merge pull request #1798 from molecula/fix-backup-key-translation
...
FB-1080 Fix backup key translation
2021-12-10 13:59:43 -06:00
Matthew Jaffee
e8972e437e
smaller clusters to take less memory... test-race getting oom killed
2021-12-10 11:52:39 -06:00
Matthew Jaffee
081184f436
another data race? fuck
2021-12-10 11:52:39 -06:00
Matthew Jaffee
f2a6ee738c
remove old shell-based backup/restore tests
2021-12-10 11:52:39 -06:00
Matthew Jaffee
53373240ef
make chksum process All() results correctly for unkeyed indexes
2021-12-10 11:52:39 -06:00
Matthew Jaffee
ea267202bd
more complete backup/restore coverage in go tests
...
I think we can remove the shell version now
2021-12-10 11:52:39 -06:00
Matthew Jaffee
1980c8b8e5
featurebase backup: don't hide TranslateStoreNotFoundError
...
I think this shouldn't happen unless there's actually a problem
2021-12-10 11:52:39 -06:00
Matthew Jaffee
b0d29bb425
fix unrelated data race that randomly cropped up in CI
2021-12-10 11:52:39 -06:00
Matthew Jaffee
3d3080df8b
full backup/restore test in a Go test
2021-12-10 11:52:39 -06:00
Matthew Jaffee
aff3d3ddd9
do a backup in a go test for coverage purposes
...
also found a weird issue with schema marshalling
if you create a field thru the api w/o specifying a field type, you
get slightly different behavior than going thru the HTTP handler which
is... not ideal. I changed the marshaler to accept an empty field type.
2021-12-10 11:52:39 -06:00
Matthew Jaffee
3761fc6d3c
have Circle build release on branch instead of waiting for merge
2021-12-10 11:52:39 -06:00
Matthew Jaffee
7a8f0135b3
redirect GetTranslateData if node doesn't own partition
2021-12-10 11:52:39 -06:00
Matthew Jaffee
b8da3bc7e6
checksum All() instead of Count(All()) to cover index keys
2021-12-10 11:52:39 -06:00
reese
e45a26cc19
Merge pull request #1804 from molecula/copyright-notice-added-back-in
...
[no-000] add copyright notice back in
2021-12-10 11:21:03 -06:00
reesporte
48aef0c8a4
add copyright notice back in
...
```bash
for file in `cat diffys`; do
printf '%s\n%s\n' "// Copyright 2021 Molecula Corp. All rights reserved." "$(cat $file)" >$file;
done
```
2021-12-10 11:01:04 -06:00
reese
eca56c52d4
Merge pull request #1803 from molecula/no-license
...
[no-000] removed license from each go file
2021-12-10 10:06:43 -06:00
reesporte
4c53f86e82
removed license from each go file
...
i used this script, a little clunky but it got the job done
```bash
for file in `find . -type f -print | grep '\.go'`; do
sed '1,/^\/\/ limitations under the License.$/d' $file > $file.tmp;
result=`cat $file.tmp`
if [[ result != "" ]]; then
gofmt $file.tmp &> /dev/null;
if [[ $? == 0 ]]; then
mv $file.tmp $file && gofmt -w $file;
else
rm $file.tmp;
fi
else
rm $file.tmp;
fi
done
```
2021-12-10 09:17:17 -06:00
reese
0f51a85002
Merge pull request #1802 from molecula/sup120-pt1
...
[FB-1092] translaste -> translate
2021-12-09 09:09:45 -06:00
reesporte
76c1d237ac
translaste -> translate
...
also remove meaingless comments
2021-12-08 16:35:26 -06:00
Matthew Jaffee
6dbbb52438
Merge pull request #1801 from molecula/simplify-coverage
...
try to simplify test coverage w/ -coverpkg
2021-12-08 13:46:51 -06:00
Matthew Jaffee
4f55f423b0
Merge branch 'master' into simplify-coverage
2021-12-08 12:57:31 -06:00
reese
134cc8c2e3
Merge pull request #1800 from molecula/sup112
...
[SUP-112] Roaring-migrate panic bug fix
2021-12-08 10:55:35 -06:00
Matthew Jaffee
c91e81537d
try something a bit different
2021-12-08 09:54:20 -06:00
reesporte
69f364e167
remove breaking test
2021-12-08 09:30:16 -06:00
reesporte
a2b86caad8
Merge branch 'master' into sup112
2021-12-08 09:24:02 -06:00
reesporte
47f78c88e0
check that translate store is not nil where it needs to be checked
2021-12-08 09:23:46 -06:00
reesporte
fed20ffd3e
test that translate key error messages are correct
2021-12-08 09:23:46 -06:00
Matthew Jaffee
a40bc3edf7
try to simplify test coverage w/ -coverpkg
2021-12-07 18:38:48 -06:00
reesporte
f223d2d84b
Merge branch 'sup112-with-tests' into sup112
2021-12-07 15:21:14 -06:00
Matthew Jaffee
4488ab1062
Merge pull request #1784 from molecula/recordbatch-ingestapi
...
add new RecordBatch implementation which uses ingest API
2021-12-06 20:40:09 -06:00
Matthew Jaffee
77897f3ef0
try to get some more test coverage on error cases
...
(without creating too much duplication!)
2021-12-06 20:19:42 -06:00
Matthew Jaffee
1a4180ca4a
add new RecordBatch implementation which uses ingest API
2021-12-06 17:06:55 -06:00
reese
7788af166f
Merge pull request #1797 from molecula/staticcheck-issues-pt-2
...
[fb-964] fixes some more staticcheck errors
2021-12-06 17:04:35 -06:00
reesporte
a0aaa0f371
don't start error messages with a capital letter
2021-12-06 16:40:13 -06:00
reesporte
0a82474a65
Merge branch 'master' into staticcheck-issues-pt-2
2021-12-06 16:33:25 -06:00
reese
8cd9dcd70d
Merge pull request #1799 from molecula/distinct-timestamp-count
...
[FB-1081] fix count on distinctTimestamp
2021-12-06 16:28:38 -06:00
reesporte
716a3a89c1
added test case
2021-12-06 16:16:43 -06:00
reesporte
060c73fb2f
add some tests for the encoding/decoding of DistinctTimestamp
2021-12-06 15:35:39 -06:00
reesporte
af3c5809e2
add support for multi-node queries
2021-12-06 14:57:05 -06:00
reesporte
4f03228968
fix count on distinctTimestamp
...
adds the ability to get the count of a distinct call to a timestamp field
2021-12-06 11:57:17 -06:00
reesporte
4c9029e0b6
Merge branch 'master' into sup112
2021-12-06 10:43:52 -06:00
reese
6ae433efbd
Merge branch 'master' into staticcheck-issues-pt-2
2021-12-06 09:11:59 -06:00
