From e40a441e0fef1fa16e5a6537d969a32c3b94c138 Mon Sep 17 00:00:00 2001 From: Krrish Dholakia Date: Thu, 21 Sep 2023 18:34:18 -0700 Subject: [PATCH] clean up docs --- docs/my-website/docs/completion/config.md | 6 +----- 1 file changed, 1 insertion(+), 5 deletions(-) diff --git a/docs/my-website/docs/completion/config.md b/docs/my-website/docs/completion/config.md index 4ccc8f4212d..7e6160f9964 100644 --- a/docs/my-website/docs/completion/config.md +++ b/docs/my-website/docs/completion/config.md @@ -4,11 +4,7 @@ Model-specific changes can make our code complicated, making it harder to debug ### usage -Handling prompt logic. - -It checks the number of tokens in the prompt and max tokens for each model. It selects the model with max tokens > prompt tokens. - -If the prompt is larger than any available model, it'll automatically trim the prompt (from the middle + preserve any system message), and fit it to the largest model available. +Handling prompt logic. Different models have different context windows. Use `adapt_to_prompt_size` to select the right model for the prompt (in case the current model is too small). ```python from litellm import completion_with_config