scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-07 08:26:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 36

docs(model_management.md): adding docs on how to add model metadata in the config.yaml

Browse source
This commit is contained in:
Krrish Dholakia 2023-12-18 17:57:22 -08:00
parent 67112ea81d
commit f73c4b494c
1 changed files with 11 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

11
docs/my-website/docs/proxy/model_management.md
View file

@ -1,6 +1,17 @@
# Model Management
Add new models + Get model info without restarting proxy.
## In Config.yaml
```yaml
model_list:
- model_name: text-davinci-003
litellm_params:
model: "text-completion-openai/text-davinci-003"
model_info:
metadata: "here's additional metadata on the model" # returned via GET /model/info
```
## Get Model Information
Retrieve detailed information about each model listed in the `/models` endpoint, including descriptions from the `config.yaml` file, and additional model info (e.g. max tokens, cost per input token, etc.) pulled the model_info you set and the litellm model cost map. Sensitive details like API keys are excluded for security purposes.