Commit graph

8121 commits

Author SHA1 Message Date
Harshit Jain
819468554f
fix(security): prevent expired key plaintext leak in error response (#18860) 2026-01-09 22:27:39 +05:30
Sameer Kankute
e7efd51bd7
Merge branch 'main' into litellm_staging_01_06_2026 2026-01-09 17:06:17 +05:30
Sameer Kankute
bb9347207b
Merge pull request #18833 from BerriAI/litellm_staging_01_08_2026
Litellm staging 01 08 2026
2026-01-09 17:04:29 +05:30
Sameer Kankute
844c766c65
Merge pull request #18763 from BerriAI/litellm_staging_01_07_2026
Staging - 01/07/2026
2026-01-09 17:01:58 +05:30
Sameer Kankute
ffa0d6706c Fix: response_format leaking into extra_body 2026-01-09 16:53:35 +05:30
Yuta Saito
5927a557fb tests: add test 2026-01-09 17:25:21 +09:00
Justas Brazauskas
c0ee5da444
Fix: Add thought_signatures to VertexGeminiConfig and test 2026-01-09 10:03:45 +02:00
Sameer Kankute
c6101ef977 [Bug]: Add Custom CA certificates to boto3 clients 2026-01-09 12:30:36 +05:30
Yuta Saito
022db6c9ed feat: add mcp registry 2026-01-09 15:07:39 +09:00
Sameer Kankute
d9b275e62a
Merge pull request #18806 from BerriAI/litellm_vertex_ai_api_key_support
[FEAT]: Add support for Vertex AI API keys
2026-01-09 09:44:36 +05:30
Yuta Saito
48bc5ccb4f fix: test 2026-01-09 11:23:47 +09:00
Yuta Saito
f129f598a0 fix: how to execute cloudzero sql 2026-01-09 10:52:48 +09:00
YutaSaito
661f03058c
Merge pull request #18802 from BerriAI/litellm_feat_focus_backend
[feat] Focus export support
2026-01-09 07:21:04 +09:00
yuneng-jiang
02eec19a1f Merge remote-tracking branch 'origin' into litellm_user_promethus_metrics 2026-01-08 10:39:46 -08:00
yuneng-jiang
1b9c7deec6 Merge remote-tracking branch 'origin' into litellm_key_team_routing_3 2026-01-08 10:39:12 -08:00
yuneng-jiang
864e8c6543
Merge pull request #18775 from BerriAI/litellm_fs_callback_fix
[Fix] Normalize Proxy Config Callback
2026-01-08 10:37:21 -08:00
Harshit Jain
516e4f8b96
fix: proactive RDS IAM token refresh to prevent 15-min connection failed (#18795)
* fix: proactive RDS IAM token refresh to prevent 15-min connection failures (#16220)

* fix: add noqa for PLR0915 in proxy_startup_event
2026-01-08 23:53:36 +05:30
Cesar Garcia
2ef8bbdf6a
fix: add xiaomi_mimo to LlmProviders enum to fix router support (#18819)
Added XIAOMI_MIMO to the LlmProviders enum in types/utils.py.
The provider was already configured in providers.json but was
missing from the enum, causing "Unsupported provider" errors
when using it in Router/Proxy configurations.

Also added comprehensive unit tests to prevent regression.
2026-01-08 23:45:57 +05:30
Cesar Garcia
1c1ee8de46
Mask extra header secrets in model info (#18822) 2026-01-08 23:42:05 +05:30
Chongshun
60edf13a21
feat(tag-routing): support toggling tag matching between ANY and ALL (#18776) 2026-01-08 23:39:03 +05:30
Constantine
3ebec39b74
fix(proxy): use async anthropic client to prevent event loop blocking (#18435)
Fixes #16716.
Previously, synchronous Anthropic client was used for token counting, which blocked the event loop.
This change switches to AsyncAnthropic and caches the client instance.
2026-01-08 23:26:46 +05:30
Ishaan Jaff
b482d336b3
[Feat] New provider - Manus API on /responses, GET /responses (#18804)
* init ManusResponsesAPIConfig

* init MANUS ApI

* init MANUS create responses

* init MANUS

* test_extract_agent_profile

* transform_get_response_api_request

* test fix

* fixes non stream

* fix streaming

* add MANUSConfig

* test_multiturn_responses_api

* code QA check

* add manus

* Potential fix for code scanning alert no. 3961: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2026-01-08 18:37:42 +05:30
Sameer Kankute
5241b27bea fix: test_video_status_basic 2026-01-08 17:30:58 +05:30
Sameer Kankute
f5b5073649 fix: test_video_status_async 2026-01-08 17:20:38 +05:30
Sameer Kankute
62d860ea7d fix: litellm/tests/test_litellm/test_responses_id_security.py 2026-01-08 17:01:44 +05:30
Sameer Kankute
0a9861c3ec Fix: test_token_counter_lazy_imports 2026-01-08 16:44:35 +05:30
Sameer Kankute
9d5eb60ff1 Fix: test_text_format_to_text_conversion - properly mock handler to avoid API calls 2026-01-08 16:37:12 +05:30
Sameer Kankute
b6e011309a Fix: test_spend_logs_payload_success_log_with_router 2026-01-08 16:07:00 +05:30
Sameer Kankute
c023c69eae
Merge pull request #18739 from BerriAI/litellm_fix_deepinfra_tool_call
[Fix]: Tool content should be string for Deepinfra
2026-01-08 15:41:56 +05:30
Sameer Kankute
c13bc21520
Merge pull request #18754 from BerriAI/litellm_add_annotations_responses_bridge
Add annotations to completions responses API bridge
2026-01-08 15:30:16 +05:30
Sameer Kankute
0eb20ad500
Merge pull request #18745 from BerriAI/litellm_fix_gemini_audio_file_upload
Fix: Gemini generate content request with audio file id
2026-01-08 15:30:09 +05:30
Sameer Kankute
df7337fd38
Merge pull request #18800 from BerriAI/litellm_add_model_id_support_bedrock
Add support for model id in bedrock passthrough
2026-01-08 15:29:47 +05:30
Sameer Kankute
e0662d53a2
Merge pull request #18799 from BerriAI/litellm_fix_claude_usage_object
Fix: Incomplete usage in response object passed
2026-01-08 15:29:26 +05:30
Sameer Kankute
c05e148488
Merge pull request #18809 from BerriAI/main
merge main
2026-01-08 15:28:13 +05:30
Sameer Kankute
c95544959b
Merge pull request #18808 from BerriAI/main
merge main
2026-01-08 15:25:50 +05:30
Sameer Kankute
6941a29ad3
Merge pull request #18807 from BerriAI/main
merge main
2026-01-08 15:25:13 +05:30
Sameer Kankute
ad501048f3 Add support for Vertex AI API keys 2026-01-08 15:22:14 +05:30
Yuta Saito
271ee0959b test: focus 2026-01-08 16:53:09 +09:00
Emerson Gomes
6c00f6f342
Add support to zai glm-4.7 model in Vertex (#18782)
* Add support to zai glm-4.7 model in Vertex

* Avoid failed on missing 'created' streaming chunk key
2026-01-08 13:20:02 +05:30
Sameer Kankute
c78bf8cfcd Add support for model id in bedrock passthrough 2026-01-08 13:03:58 +05:30
Sameer Kankute
7e98843d97 Fix: Incomplete usage in response object passed 2026-01-08 10:57:07 +05:30
yuneng-jiang
51759424a6 Key and Team Routing Setting 2026-01-07 17:17:30 -08:00
Alexsander Hamir
2f803171d6
refactor(prometheus): skip metrics for invalid API key requests (#18788) 2026-01-07 17:14:14 -08:00
Benedikt Óskarsson
81fefc69c9
fix(bedrock): handle thinking with tool calls for Claude 4 models 2026-01-08 00:48:17 +00:00
yuneng-jiang
e285e2b91d
Merge pull request #18675 from BerriAI/litellm_key_team_routing_config
[Feature] Allow Add and Update for router_settings on Keys and Teams
2026-01-07 16:24:04 -08:00
yuneng-jiang
d01c48ec5e User metrics for promethus 2026-01-07 15:05:09 -08:00
yuneng-jiang
1c84af8ae4 normalize proxy config callbacks 2026-01-07 12:22:57 -08:00
Elkhan Eminov
bae625bdc6
OpenRouter embeddings API support (#18391)
* support for OpenRouter embeddings

* add bearer

* add content header
2026-01-08 00:57:31 +05:30
Danial Khan
f126f75995
feat: pass server_tool_use and tool_search_tool_result blocks to anthropic (#18770)
* feat: Allow message types of server_tool_use and tool_search_tool_result to reach anthropic

* test: anthropic server tool use pass through testing
2026-01-08 00:47:28 +05:30
yuneng-jiang
140ce5fce2 Merge remote-tracking branch 'origin' into litellm_key_team_routing_config 2026-01-07 11:08:01 -08:00