mirror of
https://github.com/BerriAI/litellm.git
synced 2026-08-28 05:25:59 +00:00
add petals streaming to docs
This commit is contained in:
parent
a4d135eef9
commit
2c77879822
1 changed files with 14 additions and 0 deletions
|
|
@ -25,6 +25,20 @@ response = completion(
|
|||
print(response)
|
||||
```
|
||||
|
||||
## Usage with Streaming
|
||||
|
||||
```python
|
||||
response = completion(
|
||||
model="petals/petals-team/StableBeluga2",
|
||||
messages=[{ "content": "Hello, how are you?","role": "user"}],
|
||||
stream=True
|
||||
)
|
||||
|
||||
print(response)
|
||||
for chunk in response:
|
||||
print(chunk)
|
||||
```
|
||||
|
||||
### Model Details
|
||||
|
||||
| Model Name | Function Call |
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue