Felipe Gare
a87a3d0f95
adding support parameters to model_prices json
2025-10-15 16:06:44 -03:00
Eddie Richter
900a57f5b1
Adding new models to the lemonade provider
2025-10-14 16:56:36 -06:00
huangyafei
9a980f36d4
Add anthropic/claude-sonnet-4.5 to OpenRouter cost map
2025-10-14 13:57:39 -07:00
Hana Volků
55e44e1b1d
Prompt caching for anthropic models with openrouter
2025-10-14 14:51:55 +02:00
Classic298
732063074d
correct claude opus
2025-10-13 14:20:24 +02:00
Krish Dholakia
176c45d51b
Merge pull request #15472 from huangyafei/update_price
...
Add anthropic/claude-sonnet-4.5 to OpenRouter cost map
2025-10-12 22:07:04 -07:00
huangyafei
409299de84
Add anthropic/claude-sonnet-4.5 to OpenRouter cost map
2025-10-13 10:46:37 +08:00
Hampus Näsström
e650f39821
Reduce claude-4-sonnet max_output_tokens to 64k ( #15409 )
...
Claude 4 Sonnet doesn't support more than 64k output tokens: https://cloud.google.com/vertex-ai/generative-ai/docs/partner-models/claude/sonnet-4
2025-10-11 17:51:27 -07:00
jlan-nl
328505dcda
Fix prices ( #15374 )
...
Co-authored-by: IQHL (Hans Jacob Landelius) <iqhl@novnordisk.com>
2025-10-11 16:53:55 -07:00
Krish Dholakia
07ba5c1ea9
Merge branch 'main' into litellm_dev_10_10_2025_p3
2025-10-11 12:58:53 -07:00
Ishaan Jaffer
732618f55f
test_together_ai_embedding
2025-10-11 09:33:19 -07:00
Krrish Dholakia
fed1ba2891
feat(openai/): convert chat completion tool calls to responses api
...
enables gpt-5-codex to work on claude code
Closes LIT-1088
2025-10-10 19:41:11 -07:00
Brandon Cook
a0e81a7f1c
feat: add Bedrock AU Cross-Region Inference ( #15402 )
2025-10-10 14:18:51 -07:00
Sameer Kankute
513925fd12
Add OCI Cohere support with tool calling and streaming capabilities ( #15365 )
...
* Add cohere models for OCI integration
* fix mypy error
2025-10-10 11:20:18 -07:00
Krish Dholakia
9c50d0f057
Merge pull request #15383 from zainhas/patch-1
...
Add new together models
2025-10-09 22:20:45 -07:00
Emerson Gomes
22df8de01f
Add new Azure AI models with pricing details ( #15387 )
...
Adding missing Azure AI models:
* Phi-4-reasoning
* Phi-4-mini-reasoning
* MAI-DS-R1
2025-10-09 15:25:22 -07:00
Zain Hasan
553c0ffb1e
Add new together models
2025-10-09 10:59:51 -07:00
Sandesh Ghanta
e4317030bf
Add gpt-5-pro-2025-10-06 to model costs
2025-10-08 16:44:40 -07:00
Krish Dholakia
3f4d2c6ada
Add Cohere Embed v4 support for AWS Bedrock
...
Add Cohere Embed v4 support for AWS Bedrock
2025-10-07 19:10:22 -07:00
Ishaan Jaffer
7b82473bfb
fix gpt-image-1-mini
2025-10-07 17:56:51 -07:00
Tim Elfrink
d71d801e4d
Add Cohere Embed v4 support for AWS Bedrock
...
- Add cohere.embed-v4:0 to model pricing configs
- Update bedrock_embedding_models constant
- Update documentation with v4 model support
Fixes #15272
2025-10-07 22:08:12 +02:00
Sameer Kankute
51971f4750
Add gpt-realtime-mini support ( #15283 )
2025-10-07 11:27:04 -07:00
Krish Dholakia
12cbac74b1
Merge pull request #15210 from uc4w6c/feat/add_global_cross_region
...
feat: add Global Cross-Region Inference
2025-10-06 20:21:18 -07:00
Ishaan Jaff
d1d411ca2c
feat: add litellm_add_gpt_image1_mini_models ( #15259 )
2025-10-06 19:58:55 -07:00
Teddy Amkie
1ad4ef267d
Add GPT-5 Pro model configuration and documentation ( #15258 )
...
- Added gpt-5-pro entry to model_prices_and_context_window.json with complete specifications
- Mode: responses (Responses API only)
- Pricing: $15.00 input / $120.00 output (Standard), $7.50 input / $60.00 output (Batch)
- Context: 400,000 input tokens, 272,000 output tokens
- Endpoints: /v1/batch, /v1/responses only
- Features: Web Search, Function Calling, Vision, PDF Input, Prompt Caching, Reasoning
- No streaming support, no Code Interpreter, no Computer Use
- Added gpt-5-pro to supported models list in docs/my-website/src/pages/completion/supported.md
- Added gpt-5-pro to OpenAI provider documentation in docs/my-website/docs/providers/openai.md
- Added comprehensive GPT-5 Pro Special Notes section with usage examples and limitations
2025-10-06 19:43:40 -07:00
Gal Bloch
27c64c90dc
feat: Add 25 new Watson X foundation models ( #15219 )
...
Added comprehensive Watson X model support including:
- IBM Granite models (granite-4-h-small, granite-3-3-8b-instruct, granite-guardian variants, granite-vision, granite-ttm time series models)
- Meta Llama models (llama-3-2-1b/3b/11b-vision/90b-vision, llama-3-3-70b, llama-4-maverick-17b, llama-guard-3-11b-vision)
- Mistral models (mistral-medium-2505, mistral-small-2503, pixtral-12b-2409)
- Additional models (BigScience mt0-xxl-13b, Google flan-t5-xl-3b, OpenAI gpt-oss-120b, SDAIA allam-1-13b-instruct, Core42 jais-13b-chat)
All models include proper pricing, token limits, and capability flags (function calling, vision support, etc.) based on IBM Watson X documentation.
2025-10-06 12:33:05 -07:00
Yuta Saito
ba0dcfc001
feat: add Global Cross-Region Sonnet 4
2025-10-05 09:25:39 +09:00
Yuta Saito
9a1c0145da
feat: add Global Cross-Region Inference
2025-10-05 09:20:17 +09:00
Ishaan Jaff
cb385e080f
Fix "azure_ai/grok-4-fast-reasoning" entry in "model_prices_and_context_window.json" ( #15204 )
...
* fix: azure_ai/grok-4-fast-non-reasoning
* fix pricing
2025-10-04 14:50:44 -07:00
Ishaan Jaffer
2dc11316f2
fix failing deepseek-ai/DeepSeek-V3.1
2025-10-04 11:50:30 -07:00
Krish Dholakia
c83a3ac9b4
Merge pull request #14939 from Toy-97/patch-1
...
update: DeepInfra model data refresh [2025-09-26]
2025-10-03 21:48:31 -07:00
YutaSaito
81a8766b84
feat: add JP Cross-Region Inference ( #15188 )
2025-10-03 21:20:04 -07:00
Ishaan Jaff
4415b195d1
Add "eu.anthropic.claude-sonnet-4-5-20250929-v1:0" in "model_prices_and_context_window.json" ( #15181 )
...
* feat: add eu.anthropic.claude-sonnet-4-5-20250929-v1:0
* fix: nvidia_nim_models
2025-10-03 15:52:18 -07:00
Ishaan Jaff
efa782d6d2
[Feat] Add Nvidia NIM Rerank Support ( #15152 )
...
* feat: add NvidiaNimRerankConfig
* fix: NvidiaNimRerankConfig
* fix: NvidiaNimRerankConfig
* fix routing to nvidia nim
* docs nvidia nim rerank
* TestNvidiaNim
* nvidia nim rerank fixes
* fix rerank
* transform_rerank_response
* Usage with LiteLLM Proxy
* fixes linting
* NvidiaNimRerankConfig.DEFAULT_NIM_RERANK_API_BASE
* fix Custom API Base URL
* fix rerank base
* fix main.py
* fix transform
* fix linting
* map_cohere_rerank_params
* ruff fix
* linting fixes
* ruff fix
2025-10-02 18:58:52 -07:00
Krish Dholakia
6b3db2fd49
Merge pull request #15140 from niharm/fix-sonnet-4-5-200k-pricing
...
Price Fix: Add 200K prices for Sonnet 4.5
2025-10-02 17:28:47 -07:00
Mubashir Osmani
f2107a189d
add azure_ai grok-4 model family ( #15137 )
...
* added oauth mcp to docs
* added azure ai/grok-4 model family
* Revert "added oauth mcp to docs"
This reverts commit 950b7cef44
2025-10-02 14:21:12 -07:00
nihar
cd7acd2eb2
Add 200K prices for Sonnet 4.5
2025-10-02 12:39:44 -07:00
Ishaan Jaff
d9664a3ee4
fix gpt-5-chat-latest on model cost map ( #15116 )
2025-10-01 14:35:57 -07:00
Uzair Ali
fcfe856e10
Add support for GPT 5 codex models ( #14841 )
...
* Add support for GPT 5 codex models
* lint
* fixes
2025-09-30 18:44:35 -07:00
Ishaan Jaff
862736e74b
feat: add groq/moonshotai/kimi-k2-instruct-0905 ( #15079 )
2025-09-30 12:51:21 -07:00
Eddie Richter
f9e98f75a6
Adding max_input_tokens and max_output_tokens
2025-09-30 12:12:24 -06:00
Eddie Richter
ae92404d05
Initial addition of Lemonade provider.
2025-09-30 12:12:24 -06:00
Krish Dholakia
551a171243
Merge pull request #15043 from cedarm/fix-remove-vertex-latest
...
fix: remove invalid vertex -latest models
2025-09-29 21:54:53 -07:00
Ishaan Jaffer
3e474b9e81
fix claude-sonnet-4-5 model cost map
2025-09-29 18:26:29 -07:00
Ishaan Jaff
05955042d5
Add model pricing and context window for claude-sonnet-4-5 ( #15049 )
...
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
2025-09-29 15:09:40 -07:00
Ishaan Jaff
038863a1fe
[Feat] Add new claude-sonnet-4-5 model family ( #15041 )
...
* add new claude-sonnet-4-5
* docs fix
* fix tool_use_system_prompt_tokens
* add anthropic.claude-sonnet-4-5-20250929 to bedrock converse models
2025-09-29 13:09:00 -07:00
Cedar Myers
5357b1e102
fix: remove invalid vertex -latest models
2025-09-29 16:04:33 -04:00
Wenxi Onyx
ad29d2f944
add models served from ollama cloud
2025-09-28 14:06:08 -07:00
Wenxi Onyx
4adb854e51
add models served from ollama cloud
2025-09-28 13:20:35 -07:00
Krish Dholakia
f8a64345b7
Merge pull request #14942 from danielmklein/main
...
Fix inconsistent token configs for gpt-5 models
2025-09-27 07:49:19 -07:00
