litellm/tests/e2e/load
mubashir1osmani a150a3f85f fix(e2e): make load throughput suite use a fresh mock model and report failures
The stage load SLO was failing at ~95% errors while RPS looked fine. A fixed
load-mock name could reuse a stale deployment without mock_response, so Locust
hit real OpenAI. Always register a unique mock model, preflight one chat, hit
/v1/chat/completions, and attach a status/exception failure breakdown to the
assert so the next red run is diagnosable.
2026-07-18 14:08:18 -07:00
..
conftest.py fix(e2e): make load throughput suite use a fresh mock model and report failures 2026-07-18 14:08:18 -07:00
load_client.py fix(e2e): make load throughput suite use a fresh mock model and report failures 2026-07-18 14:08:18 -07:00
load_constants.py fix(e2e): make load throughput suite use a fresh mock model and report failures 2026-07-18 14:08:18 -07:00
locust_load.py fix(e2e): make load throughput suite use a fresh mock model and report failures 2026-07-18 14:08:18 -07:00
locustfile.py fix(e2e): make load throughput suite use a fresh mock model and report failures 2026-07-18 14:08:18 -07:00
test_chat_completions_throughput_e2e.py fix(e2e): make load throughput suite use a fresh mock model and report failures 2026-07-18 14:08:18 -07:00