From 22ac95b834745c0e7a6939a2caee1bd4a050e381 Mon Sep 17 00:00:00 2001 From: Ishaan Jaff Date: Fri, 5 Apr 2024 13:50:56 -0700 Subject: [PATCH] docs azure_ai command r --- docs/my-website/docs/providers/azure_ai.md | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/docs/my-website/docs/providers/azure_ai.md b/docs/my-website/docs/providers/azure_ai.md index 0166d9848d3..89e57ab5bd3 100644 --- a/docs/my-website/docs/providers/azure_ai.md +++ b/docs/my-website/docs/providers/azure_ai.md @@ -3,6 +3,11 @@ ## Sample Usage The `azure/` prefix sends this to Azure +Ensure you add `/v1` to your api_base. Your Azure AI studio `api_base` passed to litellm should look something like this +```python +api_base = "https://Mistral-large-dfgfj-serverless.eastus2.inference.ai.azure.com/v1/" +``` + ```python import litellm response = litellm.completion( @@ -13,7 +18,7 @@ response = litellm.completion( ) ``` -### Sample Usage - LiteLLM Proxy +## Sample Usage - LiteLLM Proxy Set this on your litellm proxy config.yaml ```yaml