Commit graph

1271 commits

Author SHA1 Message Date
Simon Sadedin
0a55571f75
[Feat] add au version of claude-opus-4-6 to model cost map (#20566)
Notes: General support for Opus 4.6 was added in #20506 however
it omitted the AU (australian) specific instance profile used
in Bedrock. This change only adds the the au id. It is copied
from the US model settings which is consistent with past
additions of this regional model profile.
2026-02-06 16:06:33 -08:00
Sameer Kankute
786bd6ebc0 Fix merge conflicts 2026-02-06 18:29:14 +05:30
Sameer Kankute
bfd21b5e00
Merge branch 'main' into litellm_opus_4.6_thinking 2026-02-06 14:17:40 +05:30
Sameer Kankute
1ec89b8a04 Feat: add inference_geo based pricing 2026-02-06 13:58:47 +05:30
Sameer Kankute
1bcd407af6 Add adaptive thiking for bedrock converse 2026-02-06 09:40:16 +05:30
Sameer Kankute
f15dd691b4 Fix anthropic.claude-opus-4-6-v1 for bedrock 2026-02-06 09:28:50 +05:30
Peter Dave Hello
e882296fdc Align Claude Opus 4.6 Bedrock metadata and model IDs
Unify follow-up fixes for Opus 4.6 pricing and routing metadata into
a single changeset.

Set long-context-capable Opus 4.6 entries to 1M input tokens where
>200K pricing is defined, align alias and dated capability metadata,
and add Bedrock Converse v1 IDs with and without :0 suffixes.

Keep regional endpoint pricing at a 10% premium over global entries
and mirror all cost-map changes in the backup file used for local
loading and offline fallback behavior.

Extend Opus 4.6 regression tests to verify metadata parity, Bedrock
regional pricing parity across :0 and non-:0 IDs, and converse model
registration in constants and runtime model sets.
2026-02-06 03:48:10 +08:00
Cesar Garcia
95f8cbe5ca
[Feat] add ElevenLabs eleven_v3 and eleven_multilingual_v2 to model cost map (#20522)
* [Feat] add ElevenLabs `eleven_v3` and `eleven_multilingual_v2` to model cost map

Register ElevenLabs TTS models for cost tracking:
- elevenlabs/eleven_v3: most expressive model, 70+ languages, audio tags
- elevenlabs/eleven_multilingual_v2: default TTS model, 29 languages

Also update ElevenLabs docs with supported models table and eleven_v3 audio tags example.

* docs: remove model-agnostic tip from ElevenLabs docs
2026-02-05 19:37:42 -08:00
Peter Dave Hello
dbd4bb5cf4
Add Claude Opus 4.6 (#20508)
Add Claude Opus 4.6 entries for Anthropic, Bedrock Converse, and Vertex AI.

Align pricing and capability metadata with Anthropic docs, including
long-context rates, above-200k prompt-caching rates, prefill removal,
and tool-use system prompt token counts.

Register the Bedrock Converse model ID in constants and add targeted
tests to validate model map values and converse registration.
2026-02-05 11:33:44 -08:00
Ishaan Jaff
eae5fa195e
[Feat] add claude-opus-4-6 to model cost map (#20506)
* add claude-opus-4-6 to model cost map

* fix azure_ai

* new model
2026-02-05 10:59:56 -08:00
Cesar Garcia
e0802783f3
feat(openrouter): add Qwen3-235B models (#20455)
Add OpenRouter Qwen3-235B-A22B models to the pricing configuration:
- openrouter/qwen/qwen3-235b-a22b-2507
- openrouter/qwen/qwen3-235b-a22b-thinking-2507

Closes request from PR #13019 comments.
2026-02-04 19:35:22 -08:00
Sameer Kankute
18a524a1dc
Merge pull request #20408 from BerriAI/litellm_fix_model+map_streaming
Fix supports_native_streaming for gemini and vertex ai and claude models
2026-02-04 17:56:48 +05:30
Sameer Kankute
b2feedc469
Merge pull request #20318 from BerriAI/litellm_oss_staging_02_03_2026
feat(guardrails): implement team-based isolation guardrails mgmnt (#1…
2026-02-04 17:49:30 +05:30
Sameer Kankute
5cec5c3bef fix model map json 2026-02-04 14:48:49 +05:30
Sameer Kankute
0ed5e51f9b Fix supports_native_streaming for anthropic models 2026-02-04 14:44:31 +05:30
Sameer Kankute
20c21c63d9 Fix supports_native_streaming for gemini and vertex ai models 2026-02-04 14:41:32 +05:30
Sameer Kankute
216cf4cac5 Add gemini deep research in model cost map 2026-02-04 13:38:13 +05:30
Sameer Kankute
25fa1ad4e7
Merge pull request #20386 from naaa760/fix/extra-head-chat-comp-brid
fix(proxy): forward extra headers in chat
2026-02-04 09:11:43 +05:30
Felipe Rodrigues Gare Carnielli
ea19d8dbf6 fixing glm-4.7 input cost per token 2026-02-03 09:57:00 -03:00
krauckbot
17c0a88a60
fix: add missing capability flags to vercel_ai_gateway models (#20276)
67 vercel_ai_gateway models were missing capability flags (supports_vision,
supports_function_calling, supports_tool_choice, supports_response_schema).

These capabilities were inferred from the corresponding direct provider entries
for the same models (e.g., vercel_ai_gateway/anthropic/claude-3.5-sonnet now has
the same capabilities as anthropic/claude-3.5-sonnet).

Models fixed include:
- Claude 3/3.5/3.7 (Anthropic)
- GPT-4/5 variants (OpenAI)
- Gemini 2.0/2.5 (Google)
- Grok 3/4 (xAI)
- Mistral/Mixtral variants
- Qwen models
- DeepSeek models
- And more

This ensures consistent capability reporting across providers for the same
underlying models.

Co-authored-by: krauckbot <krauckbot123@gmail.com>
2026-02-02 22:07:17 -08:00
Felipe Rodrigues Gare Carnielli
f32bd8474e adding together ai models to litellm models json 2026-02-03 00:25:58 -03:00
krauckbot
c4bbd56a56
feat: add Kimi K2.5 model entry for Moonshot provider (#20273)
Add moonshot/kimi-k2.5 model with:
- Input cost: $0.60/M tokens (6e-07)
- Output cost: $3.00/M tokens (3e-06)
- Cache read cost: $0.10/M tokens (1e-07)
- 256K context window
- Vision, function calling, tool choice, web search support

Reference: https://huggingface.co/moonshotai/Kimi-K2.5

Note: K2.5 thinking mode is controlled via API parameters, not a separate model ID.

Co-authored-by: krauckbot <krauckbot123@gmail.com>
2026-02-02 13:28:57 -08:00
Chesars
3215dc4d4e feat(vertex_ai): add global endpoint support for Qwen MaaS models
Fixes #19788

- Add `supported_regions: ["global"]` to Qwen MaaS models in model_prices_and_context_window.json
- Update `get_supported_regions()` to read directly from `model_cost` dict
- Update `get_complete_vertex_url()` to use `get_vertex_region()` for global-only models
- Update `create_vertex_url()` to generate correct URL for global location (without region prefix)
- Add tests for Qwen global endpoint support
2026-02-02 18:13:10 +05:30
Sameer Kankute
7773a92069
Merge pull request #20258 from BerriAI/litellm_cerebras_reasoning
fix: add reasoning param support for GPT OSS cerebras
2026-02-02 17:42:28 +05:30
Sameer Kankute
415c26f281 fix: add reasoning param support for GPT OSS cerebras 2026-02-02 17:20:04 +05:30
cscguochang-agent
76407bcf37 feat(bedrock): add base cache costs for sonnet v1 (#20214) 2026-02-01 09:36:51 +08:00
Ishaan Jaff
5345a763c2
[Feat] v2 - Logs view with side panel and improved UX (#20091)
* init: azure_ai/azure-model-router

* show additional_costs in CostBreakdown

* UI show cost breakdown fields

* feat: dedicated cost calc for azure ai

* test_azure_ai_model_router

* docs azure model router

* test azure model router

* fix transfrom

* Add transform file

* fix:feat: route to config

* v0 - looks decen view

* refactored code

* fix ui

* fixes ui

* complete v2 viewer

* address feedback

* address feedback
2026-01-30 18:34:13 -08:00
Sameer Kankute
a8054264ae
Merge pull request #19975 from BerriAI/litellm_oss_staging_01_29_2026
Litellm oss staging 01 29 2026
2026-01-30 16:58:28 +05:30
Sameer Kankute
fdb4b54add
Merge pull request #20009 from genga6/fix/#20006-update-max-input-tokens-for-gpt-5.2-codex
Fix `max_input_tokens` for `gpt-5.2-codex`
2026-01-30 16:18:53 +05:30
Sameer Kankute
eb50c780e9
Merge branch 'main' into litellm_oss_staging_01_29_2026 2026-01-30 09:03:05 +05:30
Ishaan Jaff
f7e1a22947
[Feat] New Model - amazon.nova-2-pro-preview-20251202-v1:0 (#20033)
* init: amazon.nova-2-pro-preview-20251202-v1:0

* init: nova amazon.nova-2-pro

* add s3_vectors
2026-01-29 16:55:55 -08:00
Takumi Matsuzawa
fa54c241e0 Fix max_input_tokens for gpt-5.2-codex 2026-01-29 15:39:17 +00:00
Sameer Kankute
df072979e5
Merge branch 'main' into litellm_oss_staging_01_28_2026 2026-01-29 17:39:42 +05:30
Sameer Kankute
ef15861fde Fix: litellm_fix_robotic_model_map_entry 2026-01-29 17:26:50 +05:30
Aaron Yim
d4031c8ba6
Add OpenRouter Kimi K2.5 (#19872)
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-28 22:34:48 -08:00
Sameer Kankute
be8a76f270 fix gemini gemini-robotics-er-1.5-preview entry 2026-01-29 09:06:44 +05:30
rushilchugh01
562f0a0282
feat: Add new OpenRouter models: xiaomi/mimo-v2-flash, z-ai/glm-4.7, z-ai/glm-4.7-flash, and minimax/minimax-m2.1. to model prices and context window (#19938)
Co-authored-by: Rushil Chugh <Rushil>
2026-01-28 18:56:20 -08:00
Sameer Kankute
3ab1b9f543 Fix gemini-robotics-er-1.5-preview name 2026-01-28 21:13:37 +05:30
Sameer Kankute
9fe8b12f44
Merge pull request #19924 from BerriAI/litellm_minimax_reasoning_caching_1
Add Prompt caching and reasoning support for MiniMax, GLM, Xiaomi
2026-01-28 18:04:13 +05:30
Sameer Kankute
f6ead49afe Add Prompt caching and reasoning support for MiniMax, GLM, Xiaomi 2026-01-28 17:25:26 +05:30
Sameer Kankute
42a0d576f3
Merge pull request #19910 from BerriAI/main
merge 01 27
2026-01-28 08:30:47 +05:30
Jay Prajapati
6a9d41234f
fix: allow tool_choice for Azure GPT-5 chat models (#19813)
* fix: don't treat gpt-5-chat as GPT-5 reasoning

* fix: mark azure gpt-5-chat as supporting tool_choice

* test: cover gpt-5-chat params on azure/openai
2026-01-27 17:51:13 -08:00
Sameer Kankute
c8a93c7d81
Merge pull request #19845 from BerriAI/litellm_gemini-robotics-er-1.5-preview2
Add  Gemini Robotics-ER 1.5 preview support
2026-01-27 17:47:44 +05:30
Sameer Kankute
c834d7d1fe
Merge branch 'main' into litellm_oss_staging_01_27_2026 2026-01-27 17:11:15 +05:30
Sameer Kankute
9a2750f8ec
Merge pull request #19617 from BerriAI/litellm_oss_staging_01_23_2026
Litellm oss staging 01 23 2026
2026-01-27 16:55:32 +05:30
Sameer Kankute
cf012a2f65 Add gemini-robotics-er-1.5-preview model in model map 2026-01-27 13:58:03 +05:30
Cesar Garcia
e4a557d95f
fix(xai): correct cached token cost calculation for xAI models (#19772)
* fix(azure): use generic cost calculator for audio token pricing

Azure audio models were charging audio output tokens at the text token
rate instead of the correct audio token rate. This resulted in costs
being ~6.65x lower than expected.

The fix replaces Azure's custom cost calculation logic with the generic
cost calculator that properly handles text, audio, cached, reasoning,
and image tokens.

Fixes #19764

* fix(xai): correct cached token cost calculation for xAI models

- Fix double-counting issue where xAI reports text_tokens = prompt_tokens
  (including cached), causing tokens to be charged twice
- Add cache_read_input_token_cost to xAI grok-3 and grok-3-mini model variants
- Detection: when text_tokens + cached_tokens > prompt_tokens, recalculate
  text_tokens = prompt_tokens - cached_tokens

xAI pricing (25% of input for cached):
- grok-3 variants: $0.75/M cached (input $3/M)
- grok-3-mini variants: $0.075/M cached (input $0.30/M)
2026-01-26 21:00:35 -08:00
Cesar Garcia
0d45b01069
fix(models): set gpt-5.2-codex mode to responses for Azure and OpenRouter (#19770)
Fixes #19754

The gpt-5.2-codex model only supports the responses API, not chat completions.
Updated azure/gpt-5.2-codex and openrouter/openai/gpt-5.2-codex entries to use
mode: "responses" and supported_endpoints: ["/v1/responses"].
2026-01-26 20:36:10 -08:00
Cesar Garcia
31a8d76d11
Update Gemini 2.0 Flash deprecation dates to March 31, 2026 (#19592)
Google announced that Gemini 2.0 Flash and Flash Lite models will be discontinued on March 31, 2026. Updated deprecation_date field for all affected model variants across different providers (vertex_ai, gemini, deepinfra, openrouter, vercel_ai_gateway).

Models updated:
- gemini-2.0-flash (added deprecation date)
- gemini-2.0-flash-001 (updated from 2026-02-05)
- gemini-2.0-flash-lite (added deprecation date)
- gemini-2.0-flash-lite-001 (updated from 2026-02-25)

All variants now correctly reflect the March 31, 2026 shutdown date.
2026-01-23 20:36:36 -08:00
John Greek
26a2c90818
[Fix] Anthropic models on Azure AI cache pricing (#19532) (#19614) 2026-01-22 20:00:40 -08:00