mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-15 23:31:29 +00:00
The stage load SLO was failing at ~95% errors while RPS looked fine. A fixed load-mock name could reuse a stale deployment without mock_response, so Locust hit real OpenAI. Always register a unique mock model, preflight one chat, hit /v1/chat/completions, and attach a status/exception failure breakdown to the assert so the next red run is diagnosable. |
||
|---|---|---|
| .. | ||
| conftest.py | ||
| load_client.py | ||
| load_constants.py | ||
| locust_load.py | ||
| locustfile.py | ||
| test_chat_completions_throughput_e2e.py | ||