litellm/tests/e2e/load
ryan-crabbe-berri f54f92437b
test(e2e): skip the throughput SLO load test pending LIT-5054 (#35381)
The SLO measures how many gateway replicas happen to be warm rather than the
request path. Clearing the floor needs roughly 5-7 replicas at ~10-14 RPS each;
stage idles at one and reactive HPA scale-up lands minutes into a ~3 minute
test.

It failed both of its assertions on consecutive days: 93.3% errors at an
inflated 264 RPS, where the failing requests never reached a pod and closed-loop
RPS rose because they failed fast, then 16.7 RPS with zero failures.

The covers marker and registry row stay put, so the cell returns to the gap
list rather than disappearing from the denominator.
2026-07-31 17:35:46 +00:00
..
conftest.py fix(e2e): register the load mock model through load_key instead of an autouse fixture so harness tests run without a proxy 2026-07-21 19:17:11 -07:00
load_client.py fix(e2e): migrate load suite from e2e_gateway to ProxyClient (#33839) 2026-07-18 19:41:03 +00:00
load_constants.py test(e2e): add Locust throughput load test that runs last (#33748) 2026-07-18 11:57:41 -07:00
locust_load.py test(e2e): add Locust throughput load test that runs last (#33748) 2026-07-18 11:57:41 -07:00
locustfile.py test(e2e): add Locust throughput load test that runs last (#33748) 2026-07-18 11:57:41 -07:00
session_anomaly.py fix(e2e): retry transient turn failures and move the weekly anomaly run to Saturday before the stable release cut 2026-07-21 16:55:44 -07:00
test_chat_completions_throughput_e2e.py test(e2e): skip the throughput SLO load test pending LIT-5054 (#35381) 2026-07-31 17:35:46 +00:00
test_session_anomaly.py test(e2e): move Admin UI Playwright suite to tests/e2e/ui (#34196) 2026-07-22 19:43:10 +00:00
test_weekly_session_anomaly_e2e.py fix(e2e): retry transient turn failures and move the weekly anomaly run to Saturday before the stable release cut 2026-07-21 16:55:44 -07:00
weekly_anomaly_config.yml test(e2e): add weekly session-anomaly load test against real providers 2026-07-21 14:54:02 -07:00