mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-12 03:48:56 +00:00
- Add --rps-control N to cap requests started per second (no concurrency cap) - Add make_request_with_rps_limit() and _rps_refill_task() for rate limiting - benchmark_endpoint() accepts rps_control; when set, ignores max_concurrent - --requests still controls total requests; works with --rps-control - Document RPS example in docstring and --help epilog |
||
|---|---|---|
| .. | ||
| health_check | ||
| benchmark_proxy_vs_provider.py | ||
| create_litellm_branch.ps1 | ||
| create_litellm_branch.sh | ||
| mock_grayswan_timeout_server.py | ||