scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-12 23:01:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 87

fix(e2e/mcp): settle propagation after MCP server registration

Browse source 
await_registered only proved one replica had synced the row; on the
two-replica stack a tools/call could land on the other pod and 404 with
server_not_found. Mirror the model path: poll, then wait out the
propagation budget from the moment registration returned.
This commit is contained in:
mubashir1osmani 2026-08-10 22:50:51 -07:00
parent 49ab201e75
commit 8d467b10a4
1 changed files with 8 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

11
tests/e2e/mcp/mcp_client.py
View file

@ -275,17 +275,22 @@ class McpClient:
).root
def await_registered(self, server_id: str) -> None:
"""Poll /v1/mcp/server until `server_id` is listed. Fails at poll_timeout.
"""Poll /v1/mcp/server until `server_id` is listed, then wait out the
propagation budget. Fails at poll_timeout.
The DB row exists the moment registration returns, but a data-plane pod
answers the listing from a registry it refreshes on a periodic DB sync, so a
pod that joined the load balancer after the write reports the server as
absent until its first sync.
absent until its first sync. The poll only proves ONE replica has the row;
settle_propagation is what makes the server safe to call on whichever
replica the next request lands on (mirrors ProxyClient.create_model).
"""
deadline = time.monotonic() + self.proxy.poll_timeout
written_at = time.monotonic()
deadline = written_at + self.proxy.poll_timeout
while True:
registered = frozenset(row.server_id for row in self.registered_servers())
if server_id in registered:
settle_propagation(written_at)
return
if time.monotonic() >= deadline:
raise AssertionError(