scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-29 06:33:28 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 267
litellm/tests/e2e/perf
History
Kerry Lu 3c0e08146d
test(perf): set every perf ceiling to 1.2x the lane median (#47590) 
* test(perf): set every perf ceiling to 1.2x the lane median

* test(perf): derive the upgrade verdict test's samples from the case ceilings

* test(perf): keep memory_growth_megabytes at 100 and 600, the metric swings 60 MB between reruns

* test(perf): keep small litellm_overhead_seconds p99 at 1.2x the lane max, it is the 3rd slowest of 300 requests

---------

Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-10-20 17:19:22 +00:00
..
cases test(perf): set every perf ceiling to 1.2x the lane median (#47590) 2026-10-20 17:19:22 +00:00
setup test(perf): measure Admin UI journey latency in a browser on the 1TB SpendLogs restore (#47486) 2026-10-20 16:18:44 +00:00
conftest.py test(e2e): rename load to perf and consolidate the opt-in into E2E_PERF_TESTS (#46077) 2026-10-12 13:54:03 -07:00
load_client.py test(e2e): rename load to perf and consolidate the opt-in into E2E_PERF_TESTS (#46077) 2026-10-12 13:54:03 -07:00
locust_load.py test(e2e): rename load to perf and consolidate the opt-in into E2E_PERF_TESTS (#46077) 2026-10-12 13:54:03 -07:00
locustfile.py test(e2e): rename load to perf and consolidate the opt-in into E2E_PERF_TESTS (#46077) 2026-10-12 13:54:03 -07:00
phase_budget.py test(e2e): rename load to perf and consolidate the opt-in into E2E_PERF_TESTS (#46077) 2026-10-12 13:54:03 -07:00
proxy_usage.py test(e2e): rename load to perf and consolidate the opt-in into E2E_PERF_TESTS (#46077) 2026-10-12 13:54:03 -07:00
session_anomaly.py test(e2e): perf rig (out-of-process mocks, PerformanceTestCase runner, per-request limits) and the small_bodies_5rps case (#46713) 2026-10-15 20:14:40 +00:00
test_database_upgrade.py test(perf): stop flagging load-balanced worker reads as restarts in database upgrade test (#47425) 2026-10-19 22:58:35 +00:00
test_perf_cases.py test(perf): gate the gateway's own overhead header, redis latency and postgres load in the perf cases (#47472) 2026-10-20 02:40:32 +00:00
test_redis_chaos_e2e.py test(e2e): rename load to perf and consolidate the opt-in into E2E_PERF_TESTS (#46077) 2026-10-12 13:54:03 -07:00
test_ui_journeys.py test(perf): measure Admin UI journey latency in a browser on the 1TB SpendLogs restore (#47486) 2026-10-20 16:18:44 +00:00
test_weekly_session_anomaly_e2e.py test(e2e): rename load to perf and consolidate the opt-in into E2E_PERF_TESTS (#46077) 2026-10-12 13:54:03 -07:00
UI_QUERIES.md test(perf): measure Admin UI journey latency in a browser on the 1TB SpendLogs restore (#47486) 2026-10-20 16:18:44 +00:00
weekly_anomaly_config.yml test(e2e): rename load to perf and consolidate the opt-in into E2E_PERF_TESTS (#46077) 2026-10-12 13:54:03 -07:00