mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-27 06:13:07 +00:00
1380e7e921
* fix(cost): price deployments from their own entry and add model_info.pricing_provider A deployment whose model_info.id equals another provider's cost-map key billed $0: register_model merged its prices onto that catalog row, and the cost calculator then resolved the id by name through get_model_info, whose provider check rejected the row. completion_cost now hands the deployment's entry straight to generic_cost_per_token on the openai and generic branches instead of re-resolving it by name. model_info.pricing_provider names the provider whose cost-map rows price a deployment when it differs from custom_llm_provider (an openai-compatible deployment pointed at a third-party host). It scopes the catalog row the deployment's entry is merged onto at registration and the provider the request is priced under at bill time. Unset keeps custom_llm_provider. * fix(logging): type the pricing_provider metadata read and sync dashboard API types * fix(logging): read pricing_provider without loop-scoped Final * refactor(router): inline the deployment pricing provider pick * fix(cost): keep only model_info.pricing_provider, drop the deployment-entry cost path --------- Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| docker-entrypoint.d | ||
| litellm-dashboard | ||
| Dockerfile | ||
| nginx.conf | ||