Sameer Kankute
afe540e88d
Fix auth issue
2025-11-25 18:26:25 +05:30
CatBraaain
9ec31bdd5b
fix: correct wrong system message handling for gemma ( #16767 )
2025-11-18 11:35:56 -08:00
Marty Sullivan
a032b077db
update veo 3 pricing and add prod models ( #16781 )
2025-11-18 11:29:45 -08:00
Sameer Kankute
acf206bec6
Add Day 0 gemini-3-pro-preview support ( #16719 )
...
* Add thinking signature support for gemini
* Add docs related to thinking signature
* remove double base64 import
* fix mypy errors
* fix litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py mypy
* Add new gemini 3 model and features
* Add docs related to gemini 3
* Update gemini 3 pricing
* fix llm translation tests
* fix mapped tests
2025-11-18 09:44:45 -08:00
mmandic-coatue
355eff8723
fix haiku-4-5 bedrock configs ( #16732 )
2025-11-17 19:52:01 -08:00
Sameer Kankute
b9bc903536
remove deprecated embedding model ( #16724 )
2025-11-17 18:46:20 -08:00
Sameer Kankute
20ba3fce70
Add deepseek-v3p1-terminus and kimi-k2-instruct in model map for fireworks ai ( #16720 )
2025-11-17 18:30:32 -08:00
Matt Morgis
f9ecf56715
Update Azure Pricing ( #16371 )
...
* add azure eu & us gpt-5 pricing
* add azure us gpt-4.1 pricing
* fix azure/o3-2025-04-16 to match azure/o3
* add azure us o3 pricing
2025-11-15 19:36:13 -08:00
Sameer Kankute
a2e3b942dc
Vector store files Stable Release ( #16643 )
...
* Add support for vector store files endpoints (#16490 )
* Add base code for vector store integration
* fix azure related tests and linting error
* fix mypy errors
* Add vector store files documentation
* fix mapped tests
* Add bytedance and ideogram support in fal ai (#16636 )
* Add fal ai flux pro v1.1 support (#16578 )
* Add fal ai flux pro v1.1 support
* Add tests and docs
---------
Co-authored-by: Ishaan Jaffer <ishaanjaffer0324@gmail.com>
2025-11-15 13:00:33 -08:00
Emerson Gomes
1dac777346
Add Vertex Kimi-K2-Thinking ( #16671 )
...
* Add Vertex Kimi-K2-Thinking
* Update model_prices_and_context_window.json
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update litellm/model_prices_and_context_window_backup.json
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-11-14 16:49:48 -08:00
fzowl
b1922e19f8
Voyageai pricing and doc update ( #16641 )
...
* Refresh VoyageAI models and prices and context
* Refresh VoyageAI models and prices and context
* Refresh VoyageAI models and prices and context
* Updating the available VoyageAI models in the docs
* Updating the available VoyageAI models in the docs
* Updating the model prices and the docs
2025-11-14 14:09:11 -08:00
Sameer Kankute
52a42e1728
Add all imagen variants in fal ai in model map ( #16579 )
2025-11-13 22:31:49 -08:00
Sameer Kankute
13993d6ea3
Add fal-ai/flux/schnell support ( #16580 )
2025-11-13 22:31:31 -08:00
Ishaan Jaffer
3feae855bd
fix mapped test
2025-11-13 17:00:09 -08:00
Ishaan Jaffer
3c662eadb4
add runwayml/eleven_multilingual_v2 pricing
2025-11-13 16:45:35 -08:00
Sameer Kankute
ea80510f78
[Feat] Day-0, Add gpt-5.1 and gpt-5.1-codex family support ( #16598 )
...
* Add day 0 support for gpt-5.1 models
* Add gpt-5.1-codex day 0 support
* update pricing values
2025-11-13 10:55:54 -08:00
Cesar Garcia
491f57a349
feat: Add support for reasoning_effort="none" for Gemini models ( #16548 )
...
Implements support for reasoning_effort="none" parameter for Gemini models,
providing significant cost savings (up to 96% cheaper) by disabling thinking
budget while maintaining response quality.
Changes:
- Added "supports_reasoning": true to gemini-2.0-flash-thinking-exp-01-21 in model config
- Implemented mapping for reasoning_effort="none" to thinkingConfig {thinkingBudget: 0, includeThoughts: false}
- Added unit test to verify the mapping works correctly
Performance impact:
- Without reasoning_effort: ~313 tokens
- With reasoning_effort="none": ~12 tokens (96% cheaper)
Closes #16420
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2025-11-12 19:41:07 -08:00
Sameer Kankute
018bd2e039
Add Gemini image edit support ( #16430 )
...
* Add gemini image edit support
* fix lint errors
* fix lint errors
* fix lint errors
* Add docs
2025-11-12 18:48:27 -08:00
Matt Cowger
51dc4a8476
fix: add new models, delete repeat models, update pricing. ( #16491 )
...
Added 4 new OpenRouter models:
openrouter/deepseek/deepseek-v3.2-exp
openrouter/minimax/minimax-m2
openrouter/z-ai/glm-4.6
openrouter/z-ai/glm-4.6:exacto ]
Updated openrouter/qwen/qwen3-coder:
Significantly reduced input/output costs (1e-06 → 2.2e-7 / 5e-06 → 9.5e-7)
Reduced max token limits (1,000,000 → 262,100)
Added supports_function_calling flag
Removed 2 duplicated Vertex AI Qwen models (just removed duplicates):
vertex_ai/qwen/qwen3-next-80b-a3b-instruct-maas
vertex_ai/qwen/qwen3-next-80b-a3b-thinking-maas
2025-11-11 19:11:22 -08:00
Ishaan Jaff
50b5cf5215
[Feat] New Provider - Add RunwayML Provider for video generations ( #16505 )
...
* add RUNWAYML
* init folders
* add RunwayMLVideoConfig
* add RUNWAYML_DEFAULT_API_VERSION
* add RunwayMLVideoConfig
* fix getting status
* add async_transform_video_content_response
* add runwayml transform_video_content_response
* fix config.yaml
* add runwayml docs
* add runwayml to videos
* docs runwayml video gen
* add new models to model cost map
* TestRunwayMLVideoTransformation
* fix linting errors
2025-11-11 18:48:23 -08:00
Sameer Kankute
6cab77f53f
Added thinking streaming support for mistral ( #16434 )
2025-11-10 18:41:45 -08:00
Artem
3289038089
add kimi k2 thinking ( #16445 )
2025-11-10 15:56:06 -08:00
Sameer Kankute
e037d9315d
Add Vertex and Gemini Videos API with Cost Tracking + UI support ( #16323 )
...
* Use video id for videos api
* remove mock code
* Potential fix for code scanning alert no. 3630: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
* remove print statements
* Update video prefix for 'video_'
* Add veo with openai videos unified specs
* Add videos testing to UI
* remove mock code
* Remove not need ui changes:
* Fix mypy errors related to gemini
* fix test_transform_video_create_request
* Add vertex ai veo config
* Add vertex ai veo config
* Add cost tracking for gemini and add optional param passing
* fix bugs related to vertex ai veo
* Add Gemini Veo Video Generation in Openai Videos Unified Spec (#16229 )
* Add veo with openai videos unified specs
* Add videos testing to UI
* remove mock code
* Remove not need ui changes:
* Fix mypy errors related to gemini
* fix test_transform_video_create_request
* Add contant video duration for gemini and vertex
* Fix litellm_mapped_tests tests
* fix azure videos issue
* Added doc for videos vertex ai
* fix seconds param error
* fix lint errors
* test_transform_video_create_response_cost_tracking_no_duration
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Co-authored-by: Ishaan Jaffer <ishaanjaffer0324@gmail.com>
2025-11-08 16:03:51 -08:00
Sumit Tembe
0a527bd1d8
Fix cache_read_input_token_cost for gemini-2.5-flash ( #16354 )
2025-11-07 19:11:10 -08:00
Sameer Kankute
fd95909d9f
Add cohere embed v4 model support ( #16358 )
2025-11-07 19:10:42 -08:00
Emerson Gomes
940a72ceb0
Add Vertex MiniMAX m2 ( #16373 )
2025-11-07 14:27:42 -08:00
huangyf
20d1bed514
fix lobal.anthropic.claude-haiku-4-5-20251001-v1:0 supports_reasoning ( #16263 )
2025-11-06 19:35:57 -08:00
Ishaan Jaffer
79d6f40855
fix gemini-live-2.5-flash-preview-native-audio-09-2025
2025-11-06 17:02:50 -08:00
Sameer Kankute
11508c0339
Remove reasoning support from grok-4 models ( #16265 )
2025-11-05 18:44:05 -08:00
Sameer Kankute
34abb7de1a
Add azure gpt-5-pro in model map ( #16235 )
2025-11-05 18:41:53 -08:00
Sameer Kankute
0388e3d393
Stabilize main branch ( #16243 )
...
* Fix failing container and azure tests
* fix lint error
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-11-05 16:07:28 -08:00
Sameer Kankute
781f9df883
Add gpt-image-1 pricing for azure ( #16182 )
2025-11-04 19:21:44 -08:00
Ishaan Jaff
60f3a3b0ad
[Feat] add serxng search API provider ( #16259 )
...
* TestFirecrawlSearch
* add SearchProviders
* add to get_provider_search_config
* add FirecrawlSearchConfig
* add FirecrawlSearchRequest
* add firecrawl API docs
* add pricing firecrawl/search
* add new search APIs
* add SearXNGSearchConfig
* add searxng/search
* add serxng params
* TestSearXNGSearch
* docs serxng
* docs fix
* docs fix
* docs serxng
2025-11-04 17:56:07 -08:00
Ishaan Jaff
af78a93ecf
[Feat] /search API - add firecrawl search API support ( #16257 )
...
* TestFirecrawlSearch
* add SearchProviders
* add to get_provider_search_config
* add FirecrawlSearchConfig
* add FirecrawlSearchRequest
* add firecrawl API docs
* add pricing firecrawl/search
* add new search APIs
2025-11-04 17:52:12 -08:00
Sameer Kankute
8a904a5481
Add gemini live audio model cost in model map ( #16183 )
...
* Add gemini live audio model cost in model map
* add gemini models
2025-11-03 19:01:00 -08:00
Ishaan Jaff
57295cedef
[Feat] Add Azure AI Doc Intelligence OCR ( #16219 )
...
* TestAzureDocumentIntelligenceOCR
* add AZURE_DOCUMENT_INTELLIGENCE_API_VERSION
* add AzureDocumentIntelligenceOCRConfig
* add async_transform_ocr_response
* use async transform
* add AzureDocumentIntelligenceOCRConfig
* add AzureDocumentIntelligenceOCRConfig
* add AzureDocumentIntelligenceOCRConfig
* add get_azure_ai_ocr_config
* add azure_ai/doc-intelligence
* add azure_ai/doc-intelligence
* docs fix
* docs fix
* add azure doc intel
* fix lint error
2025-11-03 17:22:19 -08:00
Ishaan Jaff
71c61c274f
[Feat] /ocr - Add VertexAI OCR provider support + cost tracking ( #16216 )
...
* add VertexAIOCRConfig
* __all__ = ["VertexAIOCRConfig"]
add
* add get_provider_ocr_config
* use GenericLiteLLMParams for litellm params
* fix _async_prepare_ocr_request
* fix _prepare_ocr_request
* fix get_complete_url
* fix validate_environment
* add safe_get_vertex_ai_project
* add VertexAIOCRConfig
* fix get_complete_url
* add TestVertexAIOCR
* add mistral-ocr-2505 cost
* add OCR to provider info
* docs vertex ai ocr
* fix _handle_rate_limits
* Potential fix for code scanning alert no. 3632: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-11-03 15:56:49 -08:00
Tim Baumgärtner
880bdddf42
Add new model pricing for nemotron-nano-9b-v2 ( #16120 )
2025-11-01 14:07:38 -07:00
Sameer Kankute
0c743e1adc
Add E2E Container API Support ( #16136 )
...
* Add v1 cut of container api
* fix lint errors
* Add proxy support to container apis & logging support (#16049 )
* Add proxy support to container apis
* Add logging support
* Add cost tracking support for containers and documentation
* Add new constant documentation
* Add container cost in model map
* fix failing azure tests
* Update tests based on model map changes
* fix model map tests
* fix model map tests
* Container modeshould be container
* Container tests fix
* Merge branch 'main' into litellm_sameer_oct_staging_2
---------
Co-authored-by: Ishaan Jaffer <ishaanjaffer0324@gmail.com>
2025-11-01 14:03:51 -07:00
Ishaan Jaffer
73f745ee09
fix claude-sonnet-4-5-20250929
2025-10-31 17:48:49 -07:00
pale-aura
0d84c11bbe
Fix vercel_ai_gateway entry for glm-4.6 ( #16084 )
...
* Fix vercel_ai_gateway entry for glm-4.6
* Fix: add unit test for vercel_ai_gateway/zai/glm-4.6
* Fix:
Add fix for unit test on vercel_ai_gateway/zai/glm-4.6
* Remove print statements in test_vercel_ai_gateway_glm46_cost_math
2025-10-30 19:40:35 -07:00
Daniel Dimenshtein
cde9ba5f93
Update model_prices_and_context_window.json, qwen-vl models ( #16106 )
...
Add supports vision, to qwen vl models
2025-10-30 19:18:35 -07:00
Seongbin Lim
18e7eaaddb
Add gemini/gemini-embedding-001 pricing entry for Google GenAI API ( #16078 )
...
* Add gemini/gemini-embedding-001 pricing entry for Google GenAI API
Add pricing and configuration entry for "gemini/gemini-embedding-001"
model when called via Google GenAI API (google-genai provider). This
mirrors the existing Vertex AI entry ("gemini-embedding-001") but uses
the 'gemini' provider instead.
Co-Authored-By: Claude <noreply@anthropic.com>
* Update tpm and rpm for gemini/gemini-embedding-001
---------
Co-authored-by: Claude <noreply@anthropic.com>
2025-10-30 17:39:19 -07:00
Ishaan Jaffer
06449df9d3
fix codestral-embed
2025-10-29 13:15:32 -07:00
Ishaan Jaff
abbb1476ee
feat: add codestral-embed-2505 ( #16071 )
2025-10-29 13:13:55 -07:00
Ishaan Jaff
99feefd614
[Feat] Add FAL AI Image Generations on LiteLLM ( #16067 )
...
* add fal-ai provider
* fix image_generation_handler
* init FalAIImageGenerationConfig
* init cost_calculator
* init FAL AI
* TestFAL_AI_ImageGeneration
* fix load_custom_provider_entrypoints
* TestFAL_AI_ImageGeneration
* add imagen4 transform FAL AI
* add FAL AI imagen 4 transform
* BaseImageGenTest
* test_fal_ai_image_generation_basic
* add BRIA + Recraft img gen
* add recraft + BRIA
* test_fal_ai_image_generation_basic
* tests for flux PRO v11
* Add FAL AI SD
* test FAL AI SD
* docs FAL AI
* docs fal ai
* Using Model-Specific Parameters
* add fal ai model prices
* add fall_ai JPG logo
* ui fixes FAL AI
* fix linting
* fix linting
* fix bedrock test_get_request_body_stability3
* test_custom_llm_provider_entrypoint
2025-10-29 13:10:51 -07:00
Thomas Schmidt
2e7dc56895
Add Haiku 4.5 pricing for open router ( #15909 )
...
* Add Haiku 4.5 pricing for open router
* Add haiku 4.5 pricing for open router
2025-10-27 19:47:50 -07:00
dima-hx430
c5c37bf7f5
Add models missing deprecation dates ( #15976 )
2025-10-27 19:39:38 -07:00
Sameer Kankute
70650a044c
Add all sora models ( #15937 )
2025-10-26 10:10:57 -07:00
Krish Dholakia
346e036399
fix(opentelemetry.py): fix issue where headers were not being split correctly + feat(bedrock): add titan image generations w/ cost tracking ( #15916 )
...
* fix(opentelemetry.py): fix issue where headers were not being split correctly
* feat(bedrock/image): Support bedrock titan image generation
Closes https://github.com/BerriAI/litellm/issues/361
* build(model_prices_and_context_window.json): track titan image gen pricing
enables cost tracking per request
* feat(amazon_titan_transformation.py): support titan image generation cost tracking
* docs: document new model
* docs: update docs to indicate cost tracking + refactor rerank into separate doc
* fix: fix mypy linting error
* fix: fix type ignore
2025-10-25 13:45:13 -07:00
