mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-12 03:48:56 +00:00
- scripts/run_benchmark_rps_suite.py: run benchmark at 1k, 2k, ..., 10k RPS sequentially - Each run writes to benchmark_results_<rps>rps.txt (e.g. benchmark_results_1000rps.txt) - First run waits for proxy; runs 2–10 use --no-wait. --output-dir, --requests supported - proxy_cli: LITELLM_AUTO_BENCHMARK_RPS_SUITE=1 runs suite when proxy is up - Optional: LITELLM_AUTO_BENCHMARK_OUTPUT_DIR, LITELLM_AUTO_BENCHMARK_REQUESTS |
||
|---|---|---|
| .. | ||
| health_check | ||
| benchmark_proxy_vs_provider.py | ||
| create_litellm_branch.ps1 | ||
| create_litellm_branch.sh | ||
| mock_grayswan_timeout_server.py | ||
| run_benchmark_after_proxy.py | ||
| run_benchmark_rps_suite.py | ||