litellm/scripts
Alexsander Hamir dae2ffb070 feat(benchmark): add RPS mode with --rps-control
- Add --rps-control N to cap requests started per second (no concurrency cap)
- Add make_request_with_rps_limit() and _rps_refill_task() for rate limiting
- benchmark_endpoint() accepts rps_control; when set, ignores max_concurrent
- --requests still controls total requests; works with --rps-control
- Document RPS example in docstring and --help epilog
2026-02-02 12:51:21 -08:00
..
health_check Add custom auth header support and increase default prompt size to 100k chars (#19436) 2026-01-20 13:25:12 -08:00
benchmark_proxy_vs_provider.py feat(benchmark): add RPS mode with --rps-control 2026-02-02 12:51:21 -08:00
create_litellm_branch.ps1 feat: add script to create branches with litellm_ prefix (#17606) 2025-12-06 10:41:39 -08:00
create_litellm_branch.sh enhance: create_litellm_branch tool to be more robust (#17874) 2025-12-12 05:35:50 -08:00
mock_grayswan_timeout_server.py implement failopen option default to True on grayswan guardrail (#18266) 2026-01-06 15:17:05 +05:30