scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-10 03:28:53 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 84

docs

Browse source
This commit is contained in:
ishaan-jaff 2023-09-19 09:24:10 -07:00
parent bee1224aa2
commit 5830de4417
2 changed files with 25 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

24
docs/my-website/docs/providers/petals.md Normal file
View file

@ -0,0 +1,24 @@
# Petals
LiteLLM supports Claude-1, 1.2 and Claude-2.
## Usage
Ensure you add `petals/` as a prefix for all petals LLMs. This sets the custom_llm_provider to petals
```python
from litellm import completion
response = completion(
model="petals/petals-team/StableBeluga2",
messages=[{ "content": "Hello, how are you?","role": "user"}]
)
print(response)
```
### Model Details
| Model Name | Function Call | Required OS Variables |
|------------------|--------------------------------------------|--------------------------------------|
| claude-instant-1 | `completion('claude-instant-1', messages)` | `os.environ['ANTHROPIC_API_KEY']` |
| claude-instant-1.2 | `completion('claude-instant-1.2', messages)` | `os.environ['ANTHROPIC_API_KEY']` |
| claude-2 | `completion('claude-2', messages)` | `os.environ['ANTHROPIC_API_KEY']` |

1
docs/my-website/sidebars.js
View file

@ -73,6 +73,7 @@ const sidebars = {
"providers/ollama",
"providers/custom",
"providers/custom_openai_proxy",
"providers/petals",
]
},
"set_keys",