mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-12 23:01:41 +00:00
docs(simple_proxy.md): add model alias to docs
This commit is contained in:
parent
5a2a9baa78
commit
847de09308
1 changed files with 17 additions and 0 deletions
|
|
@ -470,6 +470,23 @@ model_list:
|
|||
```shell
|
||||
docker run -e PORT=8000 -p 8000:8000 -v $(pwd)/config.yaml:/app/config.yaml ghcr.io/berriai/litellm:latest
|
||||
```
|
||||
## Model Alias
|
||||
|
||||
Set a model alias for your deployments.
|
||||
|
||||
In the `config.yaml` the model_name parameter is the user-facing name to use for your deployment.
|
||||
|
||||
E.g.: If we want to save a Huggingface TGI Mistral-7b deployment, as 'mistral-7b' for our users, we might save it as:
|
||||
|
||||
```yaml
|
||||
model_list:
|
||||
- model_name: mistral-7b # ALIAS
|
||||
litellm_params:
|
||||
model: huggingface/mistralai/Mistral-7B-Instruct-v0.1 # ACTUAL NAME
|
||||
api_key: your_huggingface_api_key # [OPTIONAL] if deployed on huggingface inference endpoints
|
||||
api_base: your_api_base # url where model is deployed
|
||||
```
|
||||
|
||||
## Caching
|
||||
|
||||
Add Redis Caching to your server via environment variables
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue