Commit graph

1980 commits

Author SHA1 Message Date
Ishaan Jaff
9e9ba6861d
[Feat] Add new VertexAI image models vertex_ai/imagen-4.0-generate-001, vertex_ai/imagen-4.0-ultra-generate-001, vertex_ai/imagen-4.0-fast-generate-001 (#13874)
* add vertex_ai/imagen-4.0-fast-generate-001

* add vertex_ai/imagen-4.0-ultra-generate-001

* add vertex_ai/imagen-4.0-generate-001
2025-08-21 15:15:44 -07:00
Sameer Kankute
5ac4fb512c Add support for voyage-context-3 embedding model 2025-08-22 00:15:12 +05:30
Krrish Dholakia
ebab77e7ce build(model_prices_and_context_window.json): remove retired dbrx model 2025-08-20 21:27:06 -07:00
Krrish Dholakia
ea39094658 build(model_prices_and_context_window.json): remove deprecated model from model cost map 2025-08-20 21:24:18 -07:00
Ishaan Jaff
55dcaded72
[Feat] Add VertexAI qwen API Service (#13828)
* add support for vertex AI QWEN API

* streaming QWEN API support

* test_partner_models_httpx

* test_partner_models_httpx_streaming

* add cost tracking for vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maa

* docs qwen models vertexAI
2025-08-20 15:00:33 -07:00
Ishaan Jaff
6f6fd0de0d
add fireworks_ai/accounts/fireworks/models/deepseek-v3-0324 (#13821) 2025-08-20 14:31:24 -07:00
Krish Dholakia
bfe814f981
Merge pull request #13637 from Tasmay-Tibrewal/main
Added Qwen3, Deepseek R1 0528 Throughput, GLM 4.5 and GPT-OSS models for Together AI
2025-08-19 22:33:17 -07:00
Krish Dholakia
749bafc550
Merge pull request #13660 from BerriAI/litellm_azure_gpt-t
[LLM Translation] Adjust max_input_tokens for azure/gpt-5-chat models in JSON configuration
2025-08-19 22:32:56 -07:00
Krish Dholakia
be30bc68ae
Merge pull request #13759 from kankute-sameer/litellm_feat_correct_cost_calculations
Add long context support for claude-4-sonnet
2025-08-19 22:30:25 -07:00
Krrish Dholakia
7d09375d52 fix: fix gpt-5-chat mappings 2025-08-19 22:21:00 -07:00
Sameer Kankute
b5f0a7b49b
Merge branch 'main' into litellm_feat_correct_cost_calculations 2025-08-19 18:55:36 +05:30
Sameer Kankute
4f38a63152 Add long context support for claude-4-sonnet 2025-08-19 16:40:12 +05:30
Krish Dholakia
422447b7f1
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle openai/v1/responses
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle `openai/v1/responses`
2025-08-18 18:59:28 -07:00
superpoussin22
b42df63d17
does not support function (#13612) 2025-08-18 08:45:25 -07:00
Jugal Bhatt
790d2d0830 [Update] Adjust max_input_tokens for azure/gpt-5-chat models in JSON configuration
* Reduced max_input_tokens from 400000 to 272000 for both azure/gpt-5-chat and azure/gpt-5-chat-latest to optimize resource usage and align with updated model specifications.
2025-08-15 10:57:39 -07:00
Tasmay Pankaj Tibrewal
d9105a99ab
fixed comma delimeter issue 2025-08-15 05:07:46 +05:30
Tasmay Pankaj Tibrewal
d20391101b
fixed together ai provider name mistake 2025-08-15 04:43:52 +05:30
Tasmay Pankaj Tibrewal
4b51e5787c
added qwen3, deepseek r1 0528 throughput, glm 4.5 and gpt oss models 2025-08-15 04:33:49 +05:30
huangyafei
2b89f95e37 Add deepseek-chat-v3-0324 to OpenRouter model list 2025-08-14 10:44:15 +08:00
Ishaan Jaff
76d25926d4
[Feat] New provider - Azure AI Flux Image Generation (#13592)
* init files

* add AzureFoundryModelInfo

* fix api_version property

* add azure_ai img gen

* use AzureFoundryModelInfo

* get_base_image_generation_call_args

* add azure_ai/FLUX-1.1-pro

* add util for route_image_generation_cost_calculator

* docs azure ai flux

* fixes for flux

* fixes for AzureFoundryFluxImageGenerationConfig

* ruff fix
2025-08-13 17:20:30 -07:00
Ishaan Jaff
75bcfbb76a
[Feat] New model vertex_ai/deepseek-ai/deepseek-r1-0528-maas (#13594)
* add ertex_ai/deepseek-ai/deepseek-r1-0528-maas

* fix init

* test_model_info_for_vertex_ai_deepseek_model
2025-08-13 13:44:45 -07:00
Yuki Imajuku
b75961fb20 update openrouter claude sonnet 2025-08-13 21:05:14 +09:00
Yuki Imajuku
86d8fcf5fd update model prices and context window 2025-08-13 14:56:32 +09:00
iamkankute
3d0f417829 fix: remove incorrect web search support for azure/gpt-4.1 family 2025-08-13 11:13:56 +05:30
Ishaan Jaff
828e3e3deb
[Feat] Add Streaming support + Docs for bedrock gpt-oss model family (#13346)
* add openai.gpt-oss-20b-1:0

* update BEDROCK_CONVERSE_MODELS

* openai.gpt-oss-20b-1:0 fixes

* fix PDF input

* fix for should_fake_stream

* TestBedrockGPTOSS

* should_fake_stream

* update supports vision field for openai.gpt-oss models

* fixes for bedrock gpt oss

* fixes for should_fake_stream

* docs bedrock gpt oss models
2025-08-12 08:39:36 -07:00
Edward Samuel Pasaribu
36f160b582
Update openrouter/openai/gpt-5-mini pricing 2025-08-12 18:54:06 +08:00
Edward Samuel Pasaribu
d898f9e0dd
Add openrouter gpt-5 family models pricing 2025-08-12 18:51:56 +08:00
Krrish Dholakia
e1fd49ce91 build(model_prices_and_context_window.json): fix claude-sonnet-4 on openrouter
Fixes https://github.com/BerriAI/litellm/issues/13520
2025-08-11 23:26:06 -07:00
Timothy Lowrimore
95d9e30448
Merge branch 'main' into heroku-llms 2025-08-11 09:45:52 -06:00
Timothy Lowrimore
51b52534fb fixes misconfigured OCI models by setting supports_tool_choice: true 2025-08-11 09:40:40 -06:00
Krish Dholakia
184687157e
Litellm model cost map fixes (#13480)
* build(model_prices_and_context_window.json): fix max token values

* build(model_prices_and_context_window.json): fix max token values

* build(model_prices_and_context_window.json): fix azure gpt-5-chat pricing
2025-08-10 07:38:35 -07:00
Sannan Nasir
0e53b1feab
Add digitalocean provider (#12169)
* Add digitalocean provider

* Add digitalocean provider

* Revert "Add digitalocean provider"

This reverts commit 96dda40f45.

* changes

* fixes

* Update transformation

* refactoring

* rename provider to Gradient AI

* fixes

* Incorporte review comments

* revert changes

* fix typo

* revert change

* incorporated review comments

* Revert "Incorporte review comments"

This reverts commit 37bd51bd54.

* changes

* Revert "Revert "Incorporte review comments"

This reverts commit 37bd51bd54ef4fd52ccc12866e47f8de9476d597."

This reverts commit 68c8a198ee.

* changes

* fixes

* Update provider_specific_fields.tsx
2025-08-09 16:26:33 -07:00
Cole McIntosh
d874bec480
feat(models): add OpenRouter and Cerebras GPT-OSS models (20b, 120b) with pricing and context windows; update backup; refs #13428 (#13442) 2025-08-08 22:47:51 -07:00
Jugal D. Bhatt
f55666bf5f
fix prices for oai gpt 5 (#13441) 2025-08-08 14:33:21 -07:00
Emerson Gomes
aea5af2165
Correct GPT-5 token limits and price (#13423) 2025-08-08 08:55:33 -07:00
Ishaan Jaff
9b86d721d5 test fix oci supports tool choice 2025-08-07 15:26:25 -07:00
Ishaan Jaff
70ddde2215 fix - remove dup model entries 2025-08-07 13:22:00 -07:00
Ishaan Jaff
2e767c8faf
[Feat] add azure/gpt-5 model family (#13385)
* add azure/gpt-5 model family

* add azure gpt-5 model family

* fixes for gpt-5

* add azure/gpt-5 model family
2025-08-07 12:50:37 -07:00
Timothy Lowrimore
14155b717d
Merge branch 'main' into heroku-llms 2025-08-07 13:27:04 -06:00
Ishaan Jaff
087a1a622c
feat: Add GPT-5 model family with official OpenAI specifications (#13… (#13386)
* feat: Add GPT-5 model family with official OpenAI specifications (#13378)

* Add GPT-5 model family support

Added four new GPT-5 models:
- gpt-5: Flagship model for logic and multi-step tasks
- gpt-5-mini: Cost-sensitive version for budget use cases
- gpt-5-nano: Speed-optimized version for low latency
- gpt-5-chat: Enterprise-focused version for advanced conversations

* Update GPT-5 models with official OpenAI specifications

- Add gpt-5-chat-latest with 400k context, 128k output tokens
- Add gpt-5-2025-08-07 with enhanced reasoning capabilities
- Add gpt-5-mini-2025-08-07 with cost-optimized pricing
- Add gpt-5-nano-2025-08-07 with ultra-fast performance
- Update existing gpt-5, gpt-5-mini, gpt-5-nano to match dated versions
- All models now support reasoning tokens and 400k context window
- Pricing updated per official OpenAI documentation

* fix conflicts

---------

Co-authored-by: Cole McIntosh <82463175+colesmcintosh@users.noreply.github.com>
2025-08-07 11:58:37 -07:00
Ishaan Jaff
729e1f530a
feat - add claude-opus-4-1 on cost map (#13384) 2025-08-07 11:52:44 -07:00
Low Jian Sheng
9e0ba10f23
Add GPT 5 models (#13377)
* add gpt 5 modesl

* update max tokens
2025-08-07 11:36:16 -07:00
Timothy Lowrimore
d3809a7813
Merge branch 'main' into heroku-llms 2025-08-07 11:06:24 -06:00
breno-aumo
e8b4b25774
Update OCI docs (#13336)
* add oci models to model_prices_and_context_window.json

* remove unsupported and unavailable oci models from docs
2025-08-07 09:45:17 -07:00
Ishaan Jaff
9c5e9d7362
add groq/openai/gpt-oss (#13363) 2025-08-07 00:08:18 -07:00
Timothy Lowrimore
791c6126a4 updates price and context window for heroku models 2025-08-06 15:14:36 -06:00
Ishaan Jaff
28a894cb06
[Feat] - New model - Add Bedrock gpt oss models - "openai.gpt-oss-20b-1:0", "openai.gpt-oss-120b-1:0" (#13342)
* add openai.gpt-oss-20b-1:0

* update BEDROCK_CONVERSE_MODELS

* openai.gpt-oss-20b-1:0 fixes

* fix PDF input
2025-08-06 09:24:04 -07:00
Timothy Lowrimore
1b2dc23e7a
Merge branch 'main' into heroku-llms 2025-08-06 10:11:52 -06:00
Krrish Dholakia
2e3f564a39 fix: fix map 2025-08-05 18:33:36 -07:00
Krrish Dholakia
352b7ae913 build(model_prices_and_context_window.json): add vertex ai claude-opus-4.1
Add claude opus 4.1
2025-08-05 17:52:35 -07:00