litellm/tests/e2e/perf/cases
Kerry Lu 3c0e08146d
test(perf): set every perf ceiling to 1.2x the lane median (#47590)
* test(perf): set every perf ceiling to 1.2x the lane median

* test(perf): derive the upgrade verdict test's samples from the case ceilings

* test(perf): keep memory_growth_megabytes at 100 and 600, the metric swings 60 MB between reruns

* test(perf): keep small litellm_overhead_seconds p99 at 1.2x the lane max, it is the 3rd slowest of 300 requests

---------

Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-10-20 17:19:22 +00:00
..
__init__.py test(e2e): perf rig (out-of-process mocks, PerformanceTestCase runner, per-request limits) and the small_bodies_5rps case (#46713) 2026-10-15 20:14:40 +00:00
event_loop_stalls.py test(e2e): event_loop_stalls caps the request-handler bucket at 2, twice the gc-aware maximum (#47128) 2026-10-17 17:01:48 +00:00
mixed_size_requests_2rps.py test(perf): set every perf ceiling to 1.2x the lane median (#47590) 2026-10-20 17:19:22 +00:00
small_bodies_5rps.py test(perf): set every perf ceiling to 1.2x the lane median (#47590) 2026-10-20 17:19:22 +00:00