litellm/tests/e2e/load
Yassin Kortam a2614b1239
test(e2e): add Locust throughput load test that runs last (#33748)
CodSpeed benchmarks the SDK with no IO, so it can't catch regressions that
only appear under real concurrent load through the full proxy stack (auth,
routing, logging, spend, Postgres, Redis). This adds a Locust load test under
tests/e2e/load that drives concurrent POST /chat/completions traffic against a
mock deployment (litellm_params.mock_response), so the measured throughput
reflects proxy overhead rather than a provider's latency, and asserts an
aggregate RPS SLO with a failure-ratio guard. The test is marked load and the
parent conftest sorts load-marked items last so it never perturbs
latency-sensitive suites. Covers reliability.perf.throughput.under_slo.
2026-07-18 11:57:41 -07:00
..
conftest.py test(e2e): add Locust throughput load test that runs last (#33748) 2026-07-18 11:57:41 -07:00
load_client.py test(e2e): add Locust throughput load test that runs last (#33748) 2026-07-18 11:57:41 -07:00
load_constants.py test(e2e): add Locust throughput load test that runs last (#33748) 2026-07-18 11:57:41 -07:00
locust_load.py test(e2e): add Locust throughput load test that runs last (#33748) 2026-07-18 11:57:41 -07:00
locustfile.py test(e2e): add Locust throughput load test that runs last (#33748) 2026-07-18 11:57:41 -07:00
test_chat_completions_throughput_e2e.py test(e2e): add Locust throughput load test that runs last (#33748) 2026-07-18 11:57:41 -07:00