Yuneng Jiang b95801172c fix(e2e): only the negative fallback assertion needs every replica to agree ... litellm-e2e-ui 68 failed the test this PR was meant to stabilise: "fallback never took effect", streak 4 of a required 5, 60s timeout. Requiring a consecutive streak of 200s after the fallback is set was wrong. It asserts that the fallback path succeeds five times running, which is a reliability claim the test never intended to make, and the path is inherently retry-ish because the broken primary is attempted first on every call. One intermittent non-200 resets the streak, so a mostly-working fallback never converges. The two directions are not symmetric: before the write proving NO replica serves it -> needs every replica after the write proving the fallback serves it -> one success is the claim So the control keeps a multi-sample window and the success assertion goes back to polling for a first sighting, on the wider 60s budget rather than the original 30s that expired on litellm-e2e-ui 63. Also drops the two local rebinds Greptile flagged against the repo's no-reassignment convention: the streak counter is gone with the helper it lived in, and the cache-round loop is now a lazy generator consumed by next().		2026-08-26 18:57:38 -07:00
..
a2a	test(e2e): settle control-plane writes across every replica, not just one	2026-08-07 19:36:30 -07:00
access_control	fix(auth): resolve bare model names against wildcard deployments in model access groups (#37492)	2026-08-19 15:33:29 -07:00
batches	test(e2e): pin require_managed_files enforcement behind a marker-gated stack phase	2026-08-24 10:59:13 -07:00
claude_code	test(e2e): replay a real tool-search assistant turn back to Bedrock Invoke (#36856)	2026-08-17 11:59:26 -07:00
coverage_registry	Merge pull request #38232 from BerriAI/litellm_e2e_bedrock_customer_matrix	2026-08-26 09:34:07 -07:00
gateway	ci(e2e): record the e2e suite weekly and replay it on weekdays with zero egress (#38163)	2026-08-24 23:49:03 -04:00
guardrails	test(e2e): vendor API testing coverage (#34557)	2026-08-12 01:07:52 +00:00
llm_translation	Merge pull request #38232 from BerriAI/litellm_e2e_bedrock_customer_matrix	2026-08-26 09:34:07 -07:00
load	test(e2e): move load/perf testing out of the main suite and drop the vllm passthrough test (#35820)	2026-08-04 14:12:25 -07:00
logging	fix(otel): map /v1/messages provider errors before failure logging	2026-08-25 23:31:05 -07:00
management	test(e2e): retry timeout-shaped Mantle test_connection probes	2026-08-25 11:05:38 -07:00
mcp	test(e2e): settle control-plane writes across every replica, not just one	2026-08-07 19:36:30 -07:00
other	test(e2e): add Other suite and Guardrails coverage incl. an MCP tool-call guardrail (#34149)	2026-07-21 14:06:29 -07:00
quota_management	fix(e2e): only the negative fallback assertion needs every replica to agree	2026-08-26 18:57:38 -07:00
router	test(e2e): harden the suite against response-cache cross-talk, slow providers and single upstream blips (#37957)	2026-08-22 14:47:03 -07:00
ui	fix(e2e): only the negative fallback assertion needs every replica to agree	2026-08-26 18:57:38 -07:00
CLAUDE.md	ci(e2e): record the e2e suite weekly and replay it on weekdays with zero egress (#38163)	2026-08-24 23:49:03 -04:00
conftest.py	ci(e2e): record the e2e suite weekly and replay it on weekdays with zero egress (#38163)	2026-08-24 23:49:03 -04:00
CONTRIBUTING.md	ci(e2e): record the e2e suite weekly and replay it on weekdays with zero egress (#38163)	2026-08-24 23:49:03 -04:00
e2e_config.py	test(e2e): pin require_managed_files enforcement behind a marker-gated stack phase	2026-08-24 10:59:13 -07:00
e2e_db.py	test(e2e): guard destructive spend-log truncate behind an explicit opt-in (#33751)	2026-07-20 08:47:39 -07:00
e2e_http.py	feat(e2e): record and replay streamed provider responses chunk-for-chunk	2026-08-24 12:51:44 -07:00
fixture_bundle.py	feat(e2e): record and replay streamed provider responses chunk-for-chunk	2026-08-24 12:51:44 -07:00
fixture_canonical.py	test(e2e): key multipart uploads by structured part identity	2026-08-21 19:32:02 -07:00
fixture_mode.py	feat(e2e): move record/replay to the provider edge (LIT-5745)	2026-08-19 18:39:15 -07:00
junit_properties.py	refactor(e2e): replace bespoke result reporter with standard JUnit report (#33758)	2026-07-17 20:53:22 +00:00
lifecycle.py	test(e2e): pin openai_passthrough routing, cost logging, and file list isolation	2026-08-20 03:03:35 -07:00
models.py	test(e2e): de-flake the cost-header cache read and the router fallback control	2026-08-26 17:57:14 -07:00
otel_client.py	test(e2e): harden the suite against response-cache cross-talk, slow providers and single upstream blips (#37957)	2026-08-22 14:47:03 -07:00
provider_edge.py	fix(e2e): record a streamed chunk only after its downstream write lands	2026-08-24 13:26:58 -07:00
proxy_client.py	test(e2e): drop docstrings on the cost map model and its client accessor	2026-08-25 18:51:40 -07:00
pytest.ini	ci(e2e): record the e2e suite weekly and replay it on weekdays with zero egress (#38163)	2026-08-24 23:49:03 -04:00
test_e2e_http.py	test(e2e): retry provider-transient statuses at the transport with bounded backoff (#35824)	2026-08-04 14:57:42 -07:00
test_fixture_bundle.py	feat(e2e): record and replay streamed provider responses chunk-for-chunk	2026-08-24 12:51:44 -07:00
test_fixture_canonical.py	test(e2e): pin query params and multipart form fields as replay match-key identity	2026-08-20 15:59:34 -04:00
test_fixture_mode.py	feat(e2e): move record/replay to the provider edge (LIT-5745)	2026-08-19 18:39:15 -07:00
test_provider_edge.py	fix(e2e): record a streamed chunk only after its downstream write lands	2026-08-24 13:26:58 -07:00
transport.py	test(e2e): harden the suite against response-cache cross-talk, slow providers and single upstream blips (#37957)	2026-08-22 14:47:03 -07:00