mirror of
https://github.com/BerriAI/litellm.git
synced 2026-08-28 05:25:59 +00:00
bf873dffe4
The strict-priority e2e (added with the zero-increment limiter fix) can never pass on stage: the proxy there does not run the dynamic_rate_limiter_v3 callbacks + priority_reservation settings the module requires, confirmed by zero limiter log lines across every gateway and backend pod during the 2026-08-02 run. Config lives in the infra repo; LIT-5118 tracks adding it. The throughput SLO test failed the same run with 65.9% of requests dying at the ELB as 502/503 before reaching a pod. The per-replica SLO rework fixed the RPS-floor assertion but cannot help when stage idles at one warm gateway replica; LIT-5119 tracks pre-scaling the fleet for the load phase. Both skips name their ticket, and the coverage registry returns the two cells to the gap list while they are in place. |
||
|---|---|---|
| .. | ||
| conftest.py | ||
| quota_client.py | ||
| test_dynamic_rate_limit_priority_e2e.py | ||
| test_rate_limit_e2e.py | ||
| test_redis_backed_ratelimit_e2e.py | ||
| test_redis_circuit_breaker_e2e.py | ||
| test_tpm_excludes_cached_tokens_e2e.py | ||