scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-09 22:31:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 133

(feat) proxy - allow setting cost, context window

Browse source
This commit is contained in:
ishaan-jaff 2023-12-06 11:42:54 -08:00
parent 94f065f83c
commit de58dcc016
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
litellm/proxy/proxy_config.yaml
View file

@ -7,6 +7,9 @@ model_list:
api_version: "2023-07-01-preview"
model_info:
mode: chat
input_cost_per_token: 0.0.00006
output_cost_per_token: 0.00003
max_tokens: 4096
- model_name: openai-gpt-3.5
litellm_params:
model: gpt-3.5-turbo