mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-05 08:07:05 +00:00
bf873dffe4
The strict-priority e2e (added with the zero-increment limiter fix) can never pass on stage: the proxy there does not run the dynamic_rate_limiter_v3 callbacks + priority_reservation settings the module requires, confirmed by zero limiter log lines across every gateway and backend pod during the 2026-08-02 run. Config lives in the infra repo; LIT-5118 tracks adding it. The throughput SLO test failed the same run with 65.9% of requests dying at the ELB as 502/503 before reaching a pod. The per-replica SLO rework fixed the RPS-floor assertion but cannot help when stage idles at one warm gateway replica; LIT-5119 tracks pre-scaling the fleet for the load phase. Both skips name their ticket, and the coverage registry returns the two cells to the gap list while they are in place. |
||
|---|---|---|
| .. | ||
| conftest.py | ||
| load_client.py | ||
| load_constants.py | ||
| locust_load.py | ||
| locustfile.py | ||
| session_anomaly.py | ||
| test_chat_completions_throughput_e2e.py | ||
| test_locust_load.py | ||
| test_session_anomaly.py | ||
| test_weekly_session_anomaly_e2e.py | ||
| weekly_anomaly_config.yml | ||