litellm/tests/e2e
mubashir1osmani a150a3f85f fix(e2e): make load throughput suite use a fresh mock model and report failures
The stage load SLO was failing at ~95% errors while RPS looked fine. A fixed
load-mock name could reuse a stale deployment without mock_response, so Locust
hit real OpenAI. Always register a unique mock model, preflight one chat, hit
/v1/chat/completions, and attach a status/exception failure breakdown to the
assert so the next red run is diagnosable.
2026-07-18 14:08:18 -07:00
..
access_control test(e2e): rename Gateway to ProxyClient and expose it as a session-scoped fixture (#33750) 2026-07-18 18:41:18 +00:00
batches test(e2e): harden stage flakes for batches, UI, and MCP (#33831) 2026-07-18 19:11:54 +00:00
claude_code refactor(e2e): fold claude_code HTTP probes onto shared Gateway methods (#33760) 2026-07-18 19:03:01 +00:00
coverage_registry test(e2e): budget reset diagonal for team, org, user, and #32005 team-member keys (#33771) 2026-07-18 03:02:22 +00:00
llm_translation test(e2e): cover /v1/responses OpenAI vision and Anthropic basic (#33838) 2026-07-18 14:00:43 -07:00
load fix(e2e): make load throughput suite use a fresh mock model and report failures 2026-07-18 14:08:18 -07:00
logging test(e2e): rename Gateway to ProxyClient and expose it as a session-scoped fixture (#33750) 2026-07-18 18:41:18 +00:00
management test(e2e): harden stage flakes for batches, UI, and MCP (#33831) 2026-07-18 19:11:54 +00:00
mcp test(e2e): harden stage flakes for batches, UI, and MCP (#33831) 2026-07-18 19:11:54 +00:00
quota_management test(e2e): rename Gateway to ProxyClient and expose it as a session-scoped fixture (#33750) 2026-07-18 18:41:18 +00:00
router test(e2e): rename Gateway to ProxyClient and expose it as a session-scoped fixture (#33750) 2026-07-18 18:41:18 +00:00
CLAUDE.md chore(e2e): remove tests/e2e/docker-compose.yml (#33837) 2026-07-18 12:50:23 -07:00
conftest.py test(e2e): add Locust throughput load test that runs last (#33748) 2026-07-18 11:57:41 -07:00
CONTRIBUTING.md chore(e2e): remove tests/e2e/docker-compose.yml (#33837) 2026-07-18 12:50:23 -07:00
e2e_config.py test(e2e): harden stage flakes for batches, UI, and MCP (#33831) 2026-07-18 19:11:54 +00:00
e2e_http.py test(e2e): cover /v1/responses openai basic nonstream and stream (#33830) 2026-07-18 13:25:19 -07:00
junit_properties.py refactor(e2e): replace bespoke result reporter with standard JUnit report (#33758) 2026-07-17 20:53:22 +00:00
lifecycle.py test(e2e): rename Gateway to ProxyClient and expose it as a session-scoped fixture (#33750) 2026-07-18 18:41:18 +00:00
models.py refactor(e2e): fold claude_code HTTP probes onto shared Gateway methods (#33760) 2026-07-18 19:03:01 +00:00
proxy_client.py refactor(e2e): fold claude_code HTTP probes onto shared Gateway methods (#33760) 2026-07-18 19:03:01 +00:00
pytest.ini test(e2e): add Locust throughput load test that runs last (#33748) 2026-07-18 11:57:41 -07:00
transport.py test(e2e): probe the full spend read surface including schema-hidden routes (#32267) 2026-07-06 14:02:05 -07:00