mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-11 22:51:28 +00:00
docs(deploy.md): document how to disable pulling live model prices (faster startup time) on docker deployment
This commit is contained in:
parent
020a66c01f
commit
ae3178d5d4
1 changed files with 10 additions and 0 deletions
|
|
@ -787,6 +787,16 @@ docker run --name litellm-proxy \
|
|||
</TabItem>
|
||||
</Tabs>
|
||||
|
||||
### 6. Disable pulling live model prices
|
||||
|
||||
Disable pulling the model prices from LiteLLM's [hosted model prices file](https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json), if you're seeing long cold start times or network security issues.
|
||||
|
||||
```env
|
||||
export LITELLM_LOCAL_MODEL_COST_MAP="True"
|
||||
```
|
||||
|
||||
This will use the local model prices file instead.
|
||||
|
||||
## Platform-specific Guide
|
||||
|
||||
<Tabs>
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue