scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-07 08:26:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 89

docs(simple_proxy.md): improving tutorial

Browse source
This commit is contained in:
Krrish Dholakia 2023-11-03 14:06:08 -07:00
parent 22fd8953c1
commit 432520ffcf
1 changed files with 4 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
docs/my-website/docs/simple_proxy.md
View file

@ -211,8 +211,6 @@ $ litellm --config /path/to/config.yaml
## Multiple Models
Evaluate between multiple models.
If you have 1 model running on a local GPU and another that's hosted (e.g. on Runpod), you can call both via the same litellm server by listing them in your `config.yaml`.
```yaml
@ -227,6 +225,10 @@ model_list:
api_base: https://<my-hosted-endpoint>
```
```shell
$ litellm --config /path/to/config.yaml
```
### Evaluate model
If you're repo let's you set model name, you can call the specific model by just passing in that model's name -