scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-10 03:28:53 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 85

clean up docs

Browse source
This commit is contained in:
Krrish Dholakia 2023-09-21 18:34:18 -07:00
parent a5b780586f
commit e40a441e0f
1 changed files with 1 additions and 5 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
docs/my-website/docs/completion/config.md
View file

@ -4,11 +4,7 @@ Model-specific changes can make our code complicated, making it harder to debug
### usage
Handling prompt logic.
It checks the number of tokens in the prompt and max tokens for each model. It selects the model with max tokens > prompt tokens.
If the prompt is larger than any available model, it'll automatically trim the prompt (from the middle + preserve any system message), and fit it to the largest model available.
Handling prompt logic. Different models have different context windows. Use `adapt_to_prompt_size` to select the right model for the prompt (in case the current model is too small).
```python
from litellm import completion_with_config