mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-20 00:11:50 +00:00
docs fix
This commit is contained in:
parent
bc3a041d8e
commit
1ce56bb46c
1 changed files with 10 additions and 7 deletions
|
|
@ -72,13 +72,16 @@ A contributor PR introduced an extra `{` bracket, producing invalid JSON. The re
|
|||
|
||||
## Remediation
|
||||
|
||||
| Action | Status |
|
||||
|---|---|
|
||||
| CI validation on every PR that touches the model cost map | ✅ Done ([PR #20605](https://github.com/BerriAI/litellm/pull/20605)) |
|
||||
| Warning log when falling back to local backup | ✅ Done |
|
||||
| Integrity validation of fetched map before using it (type check, min model count, shrinkage detection) | ✅ Done |
|
||||
| Resilience test suite covering bad hosted map, bad backup, and fallback behavior | ✅ Done |
|
||||
| Sync backup file on every release | Planned |
|
||||
| # | Action | Status | Code |
|
||||
|---|---|---|---|
|
||||
| 1 | CI validation on `model_prices_and_context_window.json` | ✅ Done | [PR #20605](https://github.com/BerriAI/litellm/pull/20605) |
|
||||
| 2 | Warning log on fallback to local backup | ✅ Done | [`get_model_cost_map.py`](https://github.com/BerriAI/litellm/blob/main/litellm/litellm_core_utils/get_model_cost_map.py) |
|
||||
| 3 | `GetModelCostMap` class with integrity validation helpers | ✅ Done | [`get_model_cost_map.py`](https://github.com/BerriAI/litellm/blob/main/litellm/litellm_core_utils/get_model_cost_map.py) |
|
||||
| 4 | Validation constants (`MODEL_COST_MAP_MIN_MODEL_COUNT`, `MODEL_COST_MAP_MAX_SHRINK_PERCENT`) | ✅ Done | [`constants.py`](https://github.com/BerriAI/litellm/blob/main/litellm/constants.py) |
|
||||
| 5 | Resilience test suite (bad hosted map, bad backup, fallback, completion) | ✅ Done | [`test_model_cost_map_resilience.py`](https://github.com/BerriAI/litellm/blob/main/tests/llm_translation/test_model_cost_map_resilience.py) |
|
||||
| 6 | Test that backup model cost map always exists and contains common models | ✅ Done | [`test_model_cost_map_resilience.py`](https://github.com/BerriAI/litellm/blob/main/tests/llm_translation/test_model_cost_map_resilience.py) |
|
||||
| 7 | Sync backup file on every release | Planned | |
|
||||
| 8 | Default to local-only cost map in production | Planned | |
|
||||
|
||||
Enterprises that require zero external dependencies at import time can set `LITELLM_LOCAL_MODEL_COST_MAP=True` to skip the GitHub fetch entirely.
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue