From 051dfee421930b6f833da3636634213f234524f9 Mon Sep 17 00:00:00 2001 From: Krrish Dholakia Date: Mon, 1 Jul 2024 15:05:38 -0700 Subject: [PATCH] docs(routing.md): add docs on how to disable cooldowns --- docs/my-website/docs/routing.md | 29 +++++++++++++++++++++++++++++ 1 file changed, 29 insertions(+) diff --git a/docs/my-website/docs/routing.md b/docs/my-website/docs/routing.md index 240e6c8e04e..905954e9797 100644 --- a/docs/my-website/docs/routing.md +++ b/docs/my-website/docs/routing.md @@ -815,6 +815,35 @@ model_list: +**Expected Response** + +``` +No deployments available for selected model, Try again in 60 seconds. Passed model=claude-3-5-sonnet. pre-call-checks=False, allowed_model_region=n/a. +``` + +#### **Disable cooldowns** + + + + + +```python +from litellm import Router + + +router = Router(..., disable_cooldowns=True) +``` + + + +```yaml +router_settings: + disable_cooldowns: True +``` + + + + ### Retries For both async + sync functions, we support retrying failed requests.