From 06efe281321f748440a1ac14429738edef399e18 Mon Sep 17 00:00:00 2001
From: Krrish Dholakia <krrishdholakia@gmail.com>
Date: Tue, 16 Jul 2024 16:33:57 -0700
Subject: [PATCH] docs(reliability.md): add default fallbacks to proxy docs

---
 docs/my-website/docs/proxy/reliability.md | 27 +++++++++++++++++++++++
 1 file changed, 27 insertions(+)

diff --git a/docs/my-website/docs/proxy/reliability.md b/docs/my-website/docs/proxy/reliability.md
index 9228071b0d4..2404c744c78 100644
--- a/docs/my-website/docs/proxy/reliability.md
+++ b/docs/my-website/docs/proxy/reliability.md
@@ -434,6 +434,33 @@ litellm_settings:
 
 
 
+### Default Fallbacks 
+
+You can also set default_fallbacks, in case a specific model group is misconfigured / bad.
+
+
+```yaml
+model_list:
+	- model_name: gpt-3.5-turbo-small
+	  litellm_params:
+		model: azure/chatgpt-v-2
+        api_base: os.environ/AZURE_API_BASE
+        api_key: os.environ/AZURE_API_KEY
+        api_version: "2023-07-01-preview"
+
+    - model_name: claude-opus
+      litellm_params:
+        model: claude-3-opus-20240229
+        api_key: os.environ/ANTHROPIC_API_KEY
+
+litellm_settings:
+  default_fallbacks: ["claude-opus"]
+```
+
+This will default to claude-opus in case any model fails.
+
+A model-specific fallbacks (e.g. {"gpt-3.5-turbo-small": ["claude-opus"]}) overrides default fallback.
+
 ### Test Fallbacks! 
 
 Check if your fallbacks are working as expected.