Commit graph

9447 commits

Author SHA1 Message Date
Ben Johnson
01e8a59f76 Remove unnecessary worker pool mutex 2022-03-14 09:56:08 -06:00
hphamMolecula
9e3734e9cc
Merge pull request #1973 from molecula/fb-1188-ttl-info
FB-1188 - TTL - Better TTL logging info
2022-03-11 12:17:12 -06:00
Hoang Pham
6a2a0cf008 FB-1188 - TTL - run TtlRemoval on server start, better ttl log info message 2022-03-11 11:37:36 -06:00
rachithrr
05870bcc5b
Merge pull request #1921 from molecula/clustertest-retry-coverage-v2
FB-1159: Try to test etcd retry code
2022-03-11 07:29:18 -06:00
Todd Gruben
e64dde0b4c remove round trip 2022-03-11 06:20:07 -06:00
Todd Gruben
82d3f54a28 new delete flow to allow for qcx reset 2022-03-11 06:20:07 -06:00
Todd Gruben
e209759283 make maxdelete an optional param 2022-03-11 06:20:07 -06:00
Todd Gruben
1a8989a69b . 2022-03-11 06:20:07 -06:00
Todd Gruben
eff54f49a6 qcx finish/reset 2022-03-11 06:20:07 -06:00
Todd Gruben
dc7493ff75 optimize container after remove 2022-03-11 06:20:07 -06:00
Todd Gruben
d322cc7aef batch size 65536 2022-03-11 06:20:07 -06:00
rachithrr
d29f2d219a
Merge branch 'master' into clustertest-retry-coverage-v2 2022-03-10 17:14:39 -06:00
souhailanoor
ac450a0c95
Merge pull request #1969 from molecula/fb-1186-updates
FB-1186: make deletes concurrent
2022-03-10 17:11:23 -06:00
rachithrr
5059f37c01 Merge branch 'master' of github.com:molecula/featurebase into clustertest-retry-coverage-v2 2022-03-10 16:54:30 -06:00
rachithrr
e2ce9afce9 sonarcloud fix 2022-03-10 16:25:59 -06:00
souhailanoor
7c8fde3bd6
Merge branch 'master' into fb-1186-updates 2022-03-10 16:18:50 -06:00
Souhaila Noor
a7b849c5fa release read tx 2022-03-10 16:18:39 -06:00
Matthew Jaffee
85ea078e86
Merge pull request #1972 from molecula/remove-circle
Remove CircleCI config
2022-03-10 14:52:20 -06:00
souhailanoor
c67b8f6653
Merge branch 'master' into fb-1186-updates 2022-03-10 13:15:55 -06:00
Matthew Jaffee
92562e547e remove old circle CI config 2022-03-10 11:41:35 -06:00
rachithrr
bed6312129 clean up 2022-03-10 11:40:38 -06:00
Samir Patel
4baec78303
Merge pull request #1944 from molecula/bug-primary-ingest
[FB-1082] retry request on primary host
2022-03-10 12:23:47 -05:00
souhailanoor
c0db6670c9
Merge branch 'master' into fb-1186-updates 2022-03-10 10:29:35 -06:00
Samir Patel
48997347b9 add server side redirect to primary for ingest requests
this applies to handlePostIngestData, handlePostIngestSchema

also moves a helper method (ApplyOneIngestSchema) from
http handler to API
2022-03-10 10:22:13 -06:00
Samir Patel
17e8dbd318 client side retry ingestAPI requests on primary host
If non-primary host fails to process a request, retry on primary node.

conditions when we should not do this:
- no error
- we've aleady tried the primary
- we're making a status request to get the primary node...this
  could lead to lock contention if we allow it to happen as we are
  making an http request within an on going http request to discover
  the primary node.

This also deletes the RemoveHost method and the associated test b/c
it is not used anywhere anymore and updates the returned error type.
2022-03-10 10:22:13 -06:00
tgruben
000eccae46
Merge pull request #1971 from molecula/SUP-178
[FB-1247] undo bitmapN fix
2022-03-10 10:21:11 -06:00
rachithrr
ce776e97fc adding more chaos 2022-03-10 09:43:52 -06:00
Souhaila Noor
f653457b5a address reviewer's comments 2022-03-10 09:36:18 -06:00
Todd Gruben
57b8dcd43a go fmt 2022-03-10 09:03:07 -06:00
tgruben
52e9027c79
Update roaring.go 2022-03-10 08:26:07 -06:00
Todd Gruben
09a9932951 extra protection of bitmapToArray 2022-03-10 07:48:51 -06:00
Todd Gruben
4a6c0ab086 bitmapN not reliable et 2022-03-09 21:02:39 -06:00
Souhaila Noor
37f43d7d6f added concurrency for delete during start-up 2022-03-09 09:40:08 -06:00
Ben Johnson
b7c93072d4
Merge pull request #1966 from molecula/fb-1239
[FB-1239] Free previous RBF bitmap pointer page when replacing container
2022-03-09 08:13:02 -07:00
Ben Johnson
7cad6d2973 Free previous RBF bitmap pointer page when replacing container 2022-03-08 15:05:23 -07:00
tgruben
5545bc5e8e
Merge pull request #1967 from molecula/SUP-170-upgrade-go
[FB-1244] bump go to go 1.17.7
2022-03-08 09:52:42 -06:00
Todd Gruben
8c247ff419 bump go to go 1.17.7 2022-03-08 08:38:07 -06:00
hphamMolecula
f7639e4a0b
Merge pull request #1954 from molecula/fb-1188-ttl
FB-1188 - Added TTL field option
2022-03-08 03:59:43 -06:00
tgruben
c3ac40991f
Merge branch 'master' into fb-1188-ttl 2022-03-07 16:57:38 -06:00
Hoang Pham
8b19e7a9e1 FB-1188 - removed parseDuration error logs in proto.go 2022-03-07 11:45:29 -06:00
seebs
fae3376581
Merge pull request #1965 from molecula/fb1240
[FB-1240] handle BitN when updating an existing bitmap pointer cell
2022-03-07 11:22:33 -06:00
Hoang Pham
49cf5c8817 FB-1188 - improved description of TTL 2022-03-07 11:16:33 -06:00
Seebs
d8b9a921b8 handle BitN when updating an existing bitmap pointer cell
We have code to correctly fill in cell.BitN when a leaf cell already
exists but isn't of the correct sort, but not to handle the case where
it already exists and *is* a BitmapPtr, but doesn't necessarily have
the right BitN value.
2022-03-07 09:16:16 -06:00
tgruben
806a8875a2
Merge branch 'master' into fb-1188-ttl 2022-03-07 07:42:56 -06:00
Travis Turner
30424499fa
Merge pull request #1813 from molecula/tlt/tx-comments
Clean up some of the go-doc entries in tx.go
2022-03-04 15:30:01 -06:00
Travis Turner
c4bc78bb36
Merge branch 'master' into tlt/tx-comments 2022-03-04 15:05:39 -06:00
tgruben
0e819b7d7a
Merge branch 'master' into fb-1188-ttl 2022-03-04 11:30:46 -06:00
seebs
aed3fc7fee
Merge pull request #1963 from molecula/fb1235
[FB-1235] Don't deadlock on multiple simultaneous CreateField
2022-03-04 11:20:21 -06:00
Seebs
9135b41ca8 test multiple field creations at once on a cluster
This test tries to verify that we can create multiple fields on a cluster
without deadlocking or getting errors *other than* ErrFieldExists or
wrappers of it. The "or wrappers of it" implies a change to ConflictError's
semantics, but honestly I think it should have had those semantics all along.
2022-03-04 10:21:18 -06:00
Seebs
bc6947a9ac try not to deadlock on simultaneous CreateField to two nodes in a cluster
Two CreateField messages reaching different nodes in a cluster at the same
time could cause a deadlock because each CreateField runs with a write lock
held, then issues requests to other nodes which, at a minimum, need
a read lock and which may require a write lock. Reorder things a bit to
make the broadcast to other nodes happen outside the lock. We may also
need to do something to have nodes handle the case where something's been
created in etcd but they haven't gotten the message about it yet.
2022-03-04 10:21:18 -06:00