From ae3178d5d468375a074581b7ff501fab8a2d430b Mon Sep 17 00:00:00 2001 From: Krrish Dholakia Date: Wed, 12 Nov 2025 13:49:44 -0800 Subject: [PATCH] docs(deploy.md): document how to disable pulling live model prices (faster startup time) on docker deployment --- docs/my-website/docs/proxy/deploy.md | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/docs/my-website/docs/proxy/deploy.md b/docs/my-website/docs/proxy/deploy.md index 72f1bdeba01..e40d7acc7c8 100644 --- a/docs/my-website/docs/proxy/deploy.md +++ b/docs/my-website/docs/proxy/deploy.md @@ -787,6 +787,16 @@ docker run --name litellm-proxy \ +### 6. Disable pulling live model prices + +Disable pulling the model prices from LiteLLM's [hosted model prices file](https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json), if you're seeing long cold start times or network security issues. + +```env +export LITELLM_LOCAL_MODEL_COST_MAP="True" +``` + +This will use the local model prices file instead. + ## Platform-specific Guide