scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-07 08:26:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 36

(docs) update token trimming

Browse source
This commit is contained in:
ishaan-jaff 2023-10-30 13:56:23 -07:00
parent 7037913f9d
commit 689c14525c
1 changed files with 0 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
docs/my-website/docs/completion/message_trimming.md
View file

@ -31,8 +31,6 @@ The function uses the following parameters:
- `model`:[Optional] This is the LiteLLM model being used. This parameter is optional, as you can alternatively specify the `max_tokens` parameter.
- `system_message`:[Optional] This is a string containing an optional system message that will be preserved at the beginning of the conversation. This parameter is optional and set to `None` by default.
- `max_tokens`:[Optional] This is an int, manually set upper limit on messages
- `trim_ratio`:[Optional] This represents the target ratio of tokens to use following trimming. It's default value is 0.75, which implies that messages will be trimmed to utilise about 75%