litellm/tests/e2e/load
Kerry Lu cc1d2c66c8 test(e2e): bound chaos latency and log volume with flat ceilings
A ratio against the healthy phase cannot bound either metric. Once the Redis
circuit breaker opens, a request skips Redis instead of waiting on its socket
timeout, so the chaos phase can measure cheaper than the baseline it is compared
against: local runs came in at 0.61x baseline p90 while a log-bytes ratio read
724x. Splitting Budget into RatioBudget and AbsoluteBudget lets RSS and CPU keep
the ratio they need, since both are machine-shaped, while latency and log volume
get the wall-clock ceiling a user actually cares about.

Co-Authored-By: Claude Code <noreply@anthropic.com>
2026-09-11 13:38:01 -07:00
..
conftest.py test(e2e): rewrite the Redis timeout test as a locust chaos load test 2026-09-10 21:55:23 -07:00
load_client.py fix(e2e): migrate load suite from e2e_gateway to ProxyClient (#33839) 2026-07-18 19:41:03 +00:00
locust_load.py test(load): drive /v1/messages alongside /chat/completions in the Redis chaos test 2026-09-11 12:28:02 -07:00
locustfile.py test(e2e): address Redis chaos PR review, add log-bytes budget 2026-09-11 12:40:25 -07:00
phase_budget.py test(e2e): bound chaos latency and log volume with flat ceilings 2026-09-11 13:38:01 -07:00
proxy_usage.py test(load): pause Redis outright and budget the chaos phase against the baseline 2026-09-11 11:06:06 -07:00
session_anomaly.py fix(e2e): retry transient turn failures and move the weekly anomaly run to Saturday before the stable release cut 2026-07-21 16:55:44 -07:00
test_locust_load.py test(load): drive /v1/messages alongside /chat/completions in the Redis chaos test 2026-09-11 12:28:02 -07:00
test_phase_budget.py test(e2e): bound chaos latency and log volume with flat ceilings 2026-09-11 13:38:01 -07:00
test_proxy_usage.py test(load): pause Redis outright and budget the chaos phase against the baseline 2026-09-11 11:06:06 -07:00
test_redis_chaos_e2e.py test(e2e): bound chaos latency and log volume with flat ceilings 2026-09-11 13:38:01 -07:00
test_session_anomaly.py test(e2e): move Admin UI Playwright suite to tests/e2e/ui (#34196) 2026-07-22 19:43:10 +00:00
test_weekly_session_anomaly_e2e.py fix(e2e): retry transient turn failures and move the weekly anomaly run to Saturday before the stable release cut 2026-07-21 16:55:44 -07:00
weekly_anomaly_config.yml test(e2e): add weekly session-anomaly load test against real providers 2026-07-21 14:54:02 -07:00