Commit graph

846 commits

Author SHA1 Message Date
Ishaan Jaff
fa4c833e58 fix: supports reasoning 2025-08-30 10:29:08 -07:00
Krish Dholakia
8b11452d9e
Merge branch 'main' into add-vercel-ai-gateway-provider 2025-08-29 22:27:08 -07:00
Ishaan Jaff
be86861eb8
feat: add gpt-realtime models - gpt-realtime (#14082)
* feat: add gpt-realtime models

* add input_cost_per_image
2025-08-29 17:49:47 -07:00
Ishaan Jaff
607f425cc6
[Bug]: Fix Can't set reasoning_effort for DeepSeek-V3.1 on DeepInfra by default (#14053)
* fix DeepInfraConfig

* track supports reasoning

* fix: get_supported_openai_params

* test_deepseek_supported_openai_params
2025-08-29 13:15:43 -07:00
Ishaan Jaff
81db36c06c
add xai/grok-code-fast (#14054) 2025-08-28 18:10:04 -07:00
Ifta Khairul Alam Adil
d9f8eb27c9 fix: enable tool choice support for model prices and context window
- Updated the "supports_tool_choice" field to true in the model_prices_and_context_window.json file, allowing for tool choice functionality in the specified model.

Signed-off-by: Ifta Khairul Alam Adil <ikaadil007@gmail.com>
2025-08-27 19:46:53 +02:00
Ifta Khairul Alam Adil
8808f78ba6 Merge branch 'main' into fix/gemini-imagen-model-name-validation 2025-08-27 15:45:59 +02:00
Krish Dholakia
4613f7821d
Merge pull request #13536 from edwardsamuel/feat/openrouter-gpt-5-pricing
Add openrouter gpt-5 family models pricing
2025-08-26 23:16:53 -07:00
Krish Dholakia
201d96b2d2
Merge pull request #13917 from Toy-97/patch-1
Deepinfra Metadata Update 24082025
2025-08-26 23:13:46 -07:00
Ifta Khairul Alam Adil
0f5b31fd78 fix: resolve invalid model name error for Gemini Imagen models (#13851)
- Fix URL construction in Gemini image generation to strip 'gemini/' prefix
- Google AI API expects base model name without the prefix
- Update model references and pricing information for consistency
- Remove outdated image generation pricing entries

Fixes issue where models like 'gemini/imagen-4.0-fast-generate-preview-06-06'
were being rejected by the Google AI API due to incorrect URL formatting.
2025-08-27 04:17:35 +02:00
Ishaan Jaff
5647757ab3
[Feat] New model gemini-2.5-flash-image-preview (#13979)
* add gemini-2.5-flash-image-preview

* add gemini-2.5-flash-image-preview
2025-08-26 15:04:02 -07:00
Krish Dholakia
55c3fd62ac
Add Claude Opus 4 and 4.1 via OpenRouter and Fix Claude Sonnet 4 and 3.7 via OpenRouter in Prices and Context Window Config
Update model prices and context window
2025-08-25 23:28:39 -07:00
Krish Dholakia
3803af5ff5
Merge pull request #13566 from kankute-sameer/fix/azure-gpt4-web-search-support
fix: remove incorrect web search support for azure/gpt-4.1 family
2025-08-25 23:28:15 -07:00
Teddy Amkie
97e9502f4a Add DeepSeek-v3.1 pricing for Fireworks AI provider
- Add fireworks_ai/accounts/fireworks/models/deepseek-v3p1 model configuration
- Set context window: 128K input, 8K output tokens
- Pricing: /bin/zsh.56/1M input tokens, .68/1M output tokens
- Supports response schema and tool choice
- Based on DeepSeek API unified pricing effective Sept 2025
2025-08-25 18:41:49 -07:00
Toy-97
f2bb1ce31e
Deepinfra Metadata Update 24082025
Deepseek v3.1 Price Dropped
2025-08-24 08:30:25 +08:00
Ishaan Jaff
9750374081
[Feat] New LLM API - AI/ML API for Image Gen (#13893)
* add LlmProviders.AIML

* add AIMLChatConfig

* add aiml

* fix AimlImageGenerationConfig

* add AimlImageGenerationConfig

* add cost_calculator

* fixes for AI ML API

* add known AIML Flux image models

* add AIML Cost Calc

* add AI/ML API

* add aiml_models
2025-08-23 13:12:44 -07:00
Krish Dholakia
49cb9bdbca
Merge pull request #13843 from BerriAI/litellm_dev_08_29_2025_p3
SSO - Free SSO usage for up to 5 users + remove deprecated dbrx models (dbrx-instruct, llama 3.1)
2025-08-23 12:06:01 -07:00
Krrish Dholakia
eb7e5e3a71 Revert "build(model_prices_and_context_window.json): remove retired dbrx model"
This reverts commit 10d49d0174.
2025-08-23 10:47:44 -07:00
Krrish Dholakia
10d49d0174 build(model_prices_and_context_window.json): remove retired dbrx model 2025-08-23 10:36:52 -07:00
Krrish Dholakia
c270c5a37a build(model_prices_and_context_window.json): remove deprecated model from model cost map 2025-08-23 10:36:52 -07:00
Sameer Kankute
f239a0f78a Add openrouter deepseek/deepseek-chat-v3.1 support 2025-08-22 22:59:09 +05:30
Krish Dholakia
9c4a86e98e
Merge pull request #13868 from kankute-sameer/litellm_feat_voyage_context_3_embedding_model
[Feat] Add support for voyage-context-3 embedding model
2025-08-21 23:18:20 -07:00
Toy-97
8ba292f201
fix extra bracket.json 2025-08-22 13:21:41 +08:00
Toy-97
62ae6d8bbc
Update model metadata for deepinfra.json 2025-08-22 13:11:55 +08:00
Ishaan Jaff
5978f25299
add new gemini/imagen-4.0 models (#13876) 2025-08-21 15:32:31 -07:00
Ishaan Jaff
9e9ba6861d
[Feat] Add new VertexAI image models vertex_ai/imagen-4.0-generate-001, vertex_ai/imagen-4.0-ultra-generate-001, vertex_ai/imagen-4.0-fast-generate-001 (#13874)
* add vertex_ai/imagen-4.0-fast-generate-001

* add vertex_ai/imagen-4.0-ultra-generate-001

* add vertex_ai/imagen-4.0-generate-001
2025-08-21 15:15:44 -07:00
Sameer Kankute
5ac4fb512c Add support for voyage-context-3 embedding model 2025-08-22 00:15:12 +05:30
Krrish Dholakia
ebab77e7ce build(model_prices_and_context_window.json): remove retired dbrx model 2025-08-20 21:27:06 -07:00
Krrish Dholakia
ea39094658 build(model_prices_and_context_window.json): remove deprecated model from model cost map 2025-08-20 21:24:18 -07:00
Ishaan Jaff
55dcaded72
[Feat] Add VertexAI qwen API Service (#13828)
* add support for vertex AI QWEN API

* streaming QWEN API support

* test_partner_models_httpx

* test_partner_models_httpx_streaming

* add cost tracking for vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maa

* docs qwen models vertexAI
2025-08-20 15:00:33 -07:00
Ishaan Jaff
6f6fd0de0d
add fireworks_ai/accounts/fireworks/models/deepseek-v3-0324 (#13821) 2025-08-20 14:31:24 -07:00
Krish Dholakia
bfe814f981
Merge pull request #13637 from Tasmay-Tibrewal/main
Added Qwen3, Deepseek R1 0528 Throughput, GLM 4.5 and GPT-OSS models for Together AI
2025-08-19 22:33:17 -07:00
Krish Dholakia
749bafc550
Merge pull request #13660 from BerriAI/litellm_azure_gpt-t
[LLM Translation] Adjust max_input_tokens for azure/gpt-5-chat models in JSON configuration
2025-08-19 22:32:56 -07:00
Krish Dholakia
be30bc68ae
Merge pull request #13759 from kankute-sameer/litellm_feat_correct_cost_calculations
Add long context support for claude-4-sonnet
2025-08-19 22:30:25 -07:00
Krrish Dholakia
7d09375d52 fix: fix gpt-5-chat mappings 2025-08-19 22:21:00 -07:00
Sameer Kankute
b5f0a7b49b
Merge branch 'main' into litellm_feat_correct_cost_calculations 2025-08-19 18:55:36 +05:30
Sameer Kankute
4f38a63152 Add long context support for claude-4-sonnet 2025-08-19 16:40:12 +05:30
Krish Dholakia
422447b7f1
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle openai/v1/responses
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle `openai/v1/responses`
2025-08-18 18:59:28 -07:00
superpoussin22
b42df63d17
does not support function (#13612) 2025-08-18 08:45:25 -07:00
Jugal Bhatt
790d2d0830 [Update] Adjust max_input_tokens for azure/gpt-5-chat models in JSON configuration
* Reduced max_input_tokens from 400000 to 272000 for both azure/gpt-5-chat and azure/gpt-5-chat-latest to optimize resource usage and align with updated model specifications.
2025-08-15 10:57:39 -07:00
Tasmay Pankaj Tibrewal
d9105a99ab
fixed comma delimeter issue 2025-08-15 05:07:46 +05:30
Tasmay Pankaj Tibrewal
d20391101b
fixed together ai provider name mistake 2025-08-15 04:43:52 +05:30
Tasmay Pankaj Tibrewal
4b51e5787c
added qwen3, deepseek r1 0528 throughput, glm 4.5 and gpt oss models 2025-08-15 04:33:49 +05:30
huangyafei
2b89f95e37 Add deepseek-chat-v3-0324 to OpenRouter model list 2025-08-14 10:44:15 +08:00
Ishaan Jaff
76d25926d4
[Feat] New provider - Azure AI Flux Image Generation (#13592)
* init files

* add AzureFoundryModelInfo

* fix api_version property

* add azure_ai img gen

* use AzureFoundryModelInfo

* get_base_image_generation_call_args

* add azure_ai/FLUX-1.1-pro

* add util for route_image_generation_cost_calculator

* docs azure ai flux

* fixes for flux

* fixes for AzureFoundryFluxImageGenerationConfig

* ruff fix
2025-08-13 17:20:30 -07:00
Ishaan Jaff
75bcfbb76a
[Feat] New model vertex_ai/deepseek-ai/deepseek-r1-0528-maas (#13594)
* add ertex_ai/deepseek-ai/deepseek-r1-0528-maas

* fix init

* test_model_info_for_vertex_ai_deepseek_model
2025-08-13 13:44:45 -07:00
Yuki Imajuku
b75961fb20 update openrouter claude sonnet 2025-08-13 21:05:14 +09:00
Yuki Imajuku
86d8fcf5fd update model prices and context window 2025-08-13 14:56:32 +09:00
iamkankute
3d0f417829 fix: remove incorrect web search support for azure/gpt-4.1 family 2025-08-13 11:13:56 +05:30
Ishaan Jaff
828e3e3deb
[Feat] Add Streaming support + Docs for bedrock gpt-oss model family (#13346)
* add openai.gpt-oss-20b-1:0

* update BEDROCK_CONVERSE_MODELS

* openai.gpt-oss-20b-1:0 fixes

* fix PDF input

* fix for should_fake_stream

* TestBedrockGPTOSS

* should_fake_stream

* update supports vision field for openai.gpt-oss models

* fixes for bedrock gpt oss

* fixes for should_fake_stream

* docs bedrock gpt oss models
2025-08-12 08:39:36 -07:00