mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-13 03:59:12 +00:00
- Add --rps-control N to cap requests started per second (no concurrency cap) - Add make_request_with_rps_limit() and _rps_refill_task() for rate limiting - benchmark_endpoint() accepts rps_control; when set, ignores max_concurrent - --requests still controls total requests; works with --rps-control - Document RPS example in docstring and --help epilog |
||
|---|---|---|
| .. | ||
| health_check | ||
| benchmark_proxy_vs_provider.py | ||
| create_litellm_branch.ps1 | ||
| create_litellm_branch.sh | ||
| mock_grayswan_timeout_server.py | ||