mirror of
https://github.com/BerriAI/litellm.git
synced 2026-11-18 09:45:23 +00:00
* fix(cost): price forwarded-credential clones by their source deployment A request that forwards the client's own Authorization header goes through `_clientside_deployment`, which builds a request-scoped deployment with a new id derived from the credential and keeps the configured deployment's id as `model_info.original_model_id`. Deployment prices are registered under the configured id, so the clone's id has no cost-map entry and `select_model_name_for_cost_calc` falls back to the public price map. `get_router_model_id` exists only to find the deployment pricing entry. Return a registered clone id when one exists, and otherwise fall back to the registered `original_model_id`, so configured prices still apply to forwarded-credential requests. Spend attribution still reads `model_info.id`, so the per-credential model id is unchanged. Fixes #52038 * fix(cost): type the forwarded-credential price lookup and cover it with an integration test The original_model_id fallback added six basedpyright errors over the merge-base ceiling. The lookup now runs in a typed helper, and a proxy integration test sends /v1/messages with a forwarded client credential and checks the response cost header and spend row against the deployment's configured rates. Co-authored-by: xDipzz <deepakmahajan.2004@gmail.com> --------- Co-authored-by: xDipzz <deepakmahajan.2004@gmail.com> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| test_bundled_cost_map_price_wire.py | ||
| test_configured_prices.py | ||
| test_cost_margin_discount.py | ||
| test_databricks_cache_pricing.py | ||
| test_model_listing_token_limits.py | ||
| test_ocr_page_pricing.py | ||
| test_off_peak_pricing.py | ||
| test_opencode_go_reported_cost_wire.py | ||
| test_per_second_pricing.py | ||
| test_price_data_reload_prices.py | ||
| test_price_precedence.py | ||
| test_realtime_cached_audio_pricing.py | ||
| test_sail_service_tier_pricing.py | ||
| test_search_mode_pricing.py | ||
| test_service_tier_pricing.py | ||