scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-06 08:16:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 78

(docs) using azure_text models

Browse source
This commit is contained in:
ishaan-jaff 2024-03-12 09:54:34 -07:00
parent 223ac464d7
commit ea83c8c9b0
1 changed files with 21 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

24
docs/my-website/docs/providers/azure.md
View file

@ -118,7 +118,7 @@ response = completion(
```
### Usage - with Azure Vision enhancements
#### Usage - with Azure Vision enhancements
Note: **Azure requires the `base_url` to be set with `/extensions`**
@ -170,12 +170,30 @@ response = completion(
## Azure Instruct Models
Use `model="azure_text/<your-deployment>"`
| Model Name | Function Call |
|---------------------|----------------------------------------------------|
| gpt-3.5-turbo-instruct | `response = completion(model="azure/<your deployment name>", messages=messages)` |
| gpt-3.5-turbo-instruct-0914 | `response = completion(model="azure/<your deployment name>", messages=messages)` |
| gpt-3.5-turbo-instruct | `response = completion(model="azure_text/<your deployment name>", messages=messages)` |
| gpt-3.5-turbo-instruct-0914 | `response = completion(model="azure_text/<your deployment name>", messages=messages)` |
```python
import litellm
## set ENV variables
os.environ["AZURE_API_KEY"] = ""
os.environ["AZURE_API_BASE"] = ""
os.environ["AZURE_API_VERSION"] = ""
response = litellm.completion(
model="azure_text/<your-deployment-name",
messages=[{"role": "user", "content": "What is the weather like in Boston?"}]
)
print(response)
```
## Advanced
### Azure API Load-Balancing