Commit graph

8189 commits

Author SHA1 Message Date
souhailanoor
bbbcc7d677
Merge branch 'master' into generate-test-data-FB-971 2021-11-18 14:44:20 -06:00
souhailanoor
6623cbba8d
Merge pull request #1777 from molecula/fixEC2NodeBug
fix for ec2 ip filtering
2021-11-18 13:37:31 -06:00
souhailanoor
d8967dfb96
Merge branch 'master' into fixEC2NodeBug 2021-11-18 13:06:44 -06:00
seebs
8ae19b3c36
Merge pull request #1766 from molecula/fb1019
FB-1019: internal consistency errors in RBF
2021-11-18 12:57:41 -06:00
Souhaila Noor
4e3f31471c remove double quotes from variable name 2021-11-18 12:42:09 -06:00
Souhaila Noor
5d489198bd fixed apt install bug 2021-11-18 12:11:48 -06:00
Souhaila Noor
d40eefb364 added host:port as a command line input 2021-11-18 12:06:07 -06:00
Souhaila Noor
eb717f568d fix for ec2 ip filtering 2021-11-18 11:49:38 -06:00
tgruben
b6875476ff
Merge branch 'master' into generate-test-data-FB-971 2021-11-18 10:30:06 -06:00
Todd Gruben
442d109814 created qa folder 2021-11-18 10:28:49 -06:00
Seebs
9c0c0ec8c1 There are two related bugs here.
First, it is possible for us to end up allocating *or freeing* pages during
a modification of the free list, in a way such that the change to the free list
means that when we finish the modification which caused the allocate or free,
we've overwritten the inner change.

Second, when deallocating trees, we don't actually deallocate the branch nodes
themselves.

The former causes potentially severe data corruption. The latter causes us
to gradually leak pages in a way that we don't notice because we only run those
tests during the RBF tests.

The fix for this is surprisingly intricate, because of the counterintuitive
fact that *allocating* a page means *removing* things from the free list
(and thus potentially deallocating free list pages), while *freeing* a page
means *adding* things to the free list (and thus potentially needing to
allocate pages for the free list).

While modifying the free list, any allocations we need always just come from
the end of the file; we don't try to reuse free pages. If a page becomes
*deallocated* by a free list modification, we don't annotate it in the free
list at the instant that it happens; we stash that information until the
current modification of the free list happens, then iterate through any
such pages.

I am pretty sure there's virtually never more than one, and I don't actually
know that I can create a case wherein we'd end up with the nested case
firing, wherein removing a page from the free list causes us to remove another
page, but I think if the free list got large and cluttered and needed
rebalancing or something it could maybe happen.
2021-11-18 10:05:55 -06:00
Seebs
a38c219cf3 Add test for RBF failures
This test case triggers a failure in RBF, it's a separate patch to
make it easier to see the failure.
2021-11-18 10:05:54 -06:00
reese
db99b83bb2
Merge pull request #1772 from molecula/sup-102
[SUP-102] fix presentation of timestamps in Groupby, Distinct calls from psql client
2021-11-17 13:15:16 -06:00
Kasey C. Rodgers
9302775fd8
generate csv files that simulate Samsung's data 2021-11-17 08:21:57 -08:00
reesporte
ea96c10114 fix typo 2021-11-17 09:10:50 -06:00
reesporte
6419a87797 use util function for formatting timestamp 2021-11-17 09:07:08 -06:00
reesporte
f8e93871c0 refactor safeCopy to pure function and add unit test 2021-11-17 08:51:28 -06:00
reesporte
7390ae072d Merge branch 'master' into sup-102 2021-11-17 08:11:03 -06:00
seebs
2e0b5cb55b
Merge pull request #1774 from molecula/fbholder
unbreak featurebase holder subcommand
2021-11-16 15:18:06 -06:00
reesporte
1cc6a87d20 refactor and add test 2021-11-16 14:53:30 -06:00
Seebs
dcab1a6708 unbreak featurebase holder subcommand
The "just open the holder" subcommand doesn't work the way it used
to, because now that we rely on etcd to open a holder, trying to open
a holder without things set up just coredumps.

Step 1: Fix that.
Step 2: Also add a test that covers it so we don't get bitrotted again.
Step 3: Remove an unrelated stale comment that doesn't deserve its
own commit log, having to do with an option that no longer exists
which is no longer being set right under the comment saying we set it.
2021-11-16 14:23:35 -06:00
tgruben
7ee343c8fa
Merge pull request #1773 from molecula/fix-ci
Added back code coverage
2021-11-16 12:32:03 -06:00
Todd Gruben
4c966dee22 removed filter 2021-11-16 12:08:46 -06:00
reesporte
9e041803fb add license 2021-11-16 09:20:44 -06:00
reesporte
da783d97ef add test for pgWriteDistinctTimestamp 2021-11-16 09:14:15 -06:00
reesporte
24051111b6 Merge branch 'sup-102' of github.com:molecula/featurebase into sup-102 2021-11-15 17:15:51 -06:00
reesporte
9bbd946ac5 update test to ignore FieldOptions field 2021-11-15 17:15:44 -06:00
reesporte
b3b536505d fix presentation of timestamps from a groupby pql call 2021-11-15 17:15:44 -06:00
reesporte
6d6cf7e51f fix presentation of timestamps from a distinct pql call 2021-11-15 17:15:44 -06:00
reesporte
5767b778b9 Merge branch 'sup-102' of github.com:molecula/featurebase into sup-102 2021-11-15 17:13:26 -06:00
reesporte
f5afb7a3ed update test to ignore FieldOptions field 2021-11-15 17:13:19 -06:00
Todd Gruben
6413ed3228 added protection against trailing slash 2021-11-15 17:13:19 -06:00
Souhaila Noor
8770ce245e ingest and delete for samsung workflow 2021-11-15 17:13:19 -06:00
reese
3e9f78d030
Merge pull request #1769 from molecula/fix-build-lattice
[SUP-106] use go1.16.10 for build and test, add test with go1.17.3
2021-11-15 17:12:32 -06:00
reesporte
269526348e update test to ignore FieldOptions field 2021-11-15 17:03:40 -06:00
reese
d7e0a0a4c3
Merge branch 'master' into sup-102 2021-11-15 16:19:26 -06:00
reese
e817dcf0a8
Merge branch 'master' into fix-build-lattice 2021-11-15 16:04:20 -06:00
reesporte
9e570c9e84 fix presentation of timestamps from a groupby pql call 2021-11-15 15:59:51 -06:00
souhailanoor
875692a033
Merge pull request #1771 from molecula/fb973-ingest
FB-973 Create ingest workload for Samsung Simulacra
2021-11-15 15:34:21 -06:00
reesporte
96dfe845d3 fix presentation of timestamps from a distinct pql call 2021-11-15 15:04:27 -06:00
souhailanoor
54e85b8e6e
Merge branch 'master' into fb973-ingest 2021-11-15 14:55:33 -06:00
Souhaila Noor
f0a6ebae8f ingest and delete for samsung workflow 2021-11-15 14:51:57 -06:00
tgruben
5980d3d278
Merge pull request #1770 from molecula/migrate-bug
[FB-1026] added protection against trailing slash
2021-11-15 13:15:19 -06:00
Todd Gruben
7de69df424 added protection against trailing slash 2021-11-15 10:54:13 -06:00
reesporte
ed5525c836 remove long lines i guess 2021-11-15 10:19:51 -06:00
reesporte
0a4e9fe8cf move lattice build dir to right location 2021-11-15 10:16:43 -06:00
reese
dcab3a4bce
Merge branch 'master' into fix-build-lattice 2021-11-14 15:16:11 -06:00
reesporte
d1345ca265 build all with golang:1.16.10 2021-11-14 15:00:28 -06:00
reesporte
541df0fe37 is it because of the go cache? 2021-11-14 14:40:05 -06:00
reesporte
fd1a2d2e78 smh 2021-11-14 14:26:27 -06:00