docs fix spend tracking (#16675)

This commit is contained in:
Ishaan Jaff 2025-11-14 17:22:21 -08:00 committed by GitHub
parent efa4ec9294
commit bffc36794f
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 17 additions and 3 deletions

View file

@ -1,8 +1,21 @@
# Syncing Models to GitHub model_context_window
# Auto Sync New Models (Day-0 Launches)
Sync model pricing data from GitHub's `model_prices_and_context_window.json` file outside of the LiteLLM UI.
Automatically keep your model pricing and context window data up to date without restarting your service. **This allows you to add day-0 support for new models without restarting your service.**
> **📹 Video Tutorial**: [Watch how to sync models via the Admin UI](https://www.loom.com/share/ba41acc1882d41b284bbddbb0e9c27ce?sid=bdae351e-2026-4e39-932b-fcb185ff612c)
## Overview
When providers like OpenAI or Anthropic release new models (e.g., GPT-5, Claude 4), you typically need to restart your LiteLLM service to get the latest pricing and context window data.
With auto-sync, LiteLLM automatically pulls the latest model data from GitHub's [`model_prices_and_context_window.json`](https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json) without requiring a restart. This means:
- **Zero downtime** when new models are released
- **Always accurate pricing** for cost tracking and budgets
- **Automatic updates** - set it once and forget it
<iframe width="840" height="500" src="https://www.loom.com/embed/ba41acc1882d41b284bbddbb0e9c27ce?sid=bdae351e-2026-4e39-932b-fcb185ff612c" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>
<br/>
<br/>
## Quick Start

View file

@ -285,6 +285,7 @@ const sidebars = {
items: [
"proxy/cost_tracking",
"proxy/custom_pricing",
"proxy/sync_models_github",
"proxy/billing",
],
},