Commit graph

31415 commits

Author SHA1 Message Date
Harshit Jain
819468554f
fix(security): prevent expired key plaintext leak in error response (#18860) 2026-01-09 22:27:39 +05:30
Sameer Kankute
c0b05fc47a
Merge pull request #18250 from sjmatta/claude/fix-issue-17910-QBgDq
[Fix] Nova model detection for Bedrock provider (#17910)
2026-01-09 17:30:51 +05:30
Sameer Kankute
be28fcd463
Merge pull request #18858 from raghav-stripe/raghav-add-bedrock-tokencounter
feat: add Bedrock as a backend API for token counting
2026-01-09 17:10:52 +05:30
Sameer Kankute
072e3dcd0c
Merge pull request #18715 from BerriAI/litellm_staging_01_06_2026
Staging 01/06/2026
2026-01-09 17:10:04 +05:30
Sameer Kankute
e7efd51bd7
Merge branch 'main' into litellm_staging_01_06_2026 2026-01-09 17:06:17 +05:30
Sameer Kankute
bb9347207b
Merge pull request #18833 from BerriAI/litellm_staging_01_08_2026
Litellm staging 01 08 2026
2026-01-09 17:04:29 +05:30
Sameer Kankute
844c766c65
Merge pull request #18763 from BerriAI/litellm_staging_01_07_2026
Staging - 01/07/2026
2026-01-09 17:01:58 +05:30
Sameer Kankute
ffa0d6706c Fix: response_format leaking into extra_body 2026-01-09 16:53:35 +05:30
Sameer Kankute
d67b475ba4
Merge pull request #18853 from jutaz/bugfix/unbound-local-error
Fix: Add thought_signatures to VertexGeminiConfig and test
2026-01-09 16:27:12 +05:30
Raghav Jhavar
f5ee89dcf6 fix broken imports 2026-01-09 17:43:23 +07:00
Raghav Jhavar
0bdc411fb7 remove comment 2026-01-09 17:24:33 +07:00
Raghav Jhavar
ba78194ff1 add support for bedrock in token counting api 2026-01-09 17:08:07 +07:00
Sameer Kankute
940138f585
Merge pull request #18629 from akraines/fix/wildcard-routing-errors
fix: Improve error messages and validation for wildcard routing with multiple credentials
2026-01-09 14:51:13 +05:30
Yuta Saito
d4483d8422 fix: formatter 2026-01-09 17:31:30 +09:00
Yuta Saito
5927a557fb tests: add test 2026-01-09 17:25:21 +09:00
Yuta Saito
8b90e5f4dd refactor: expose MCP registry reload helper 2026-01-09 17:16:38 +09:00
Yuta Saito
8c11ddfc5b fix: periodically refresh MCP registry across instances via scheduler job 2026-01-09 17:12:17 +09:00
Justas Brazauskas
c0ee5da444
Fix: Add thought_signatures to VertexGeminiConfig and test 2026-01-09 10:03:45 +02:00
YutaSaito
0e67fdaef0
Merge pull request #18850 from BerriAI/litellm_feat_mcp-registry
[feat] add mcp registry
2026-01-09 16:16:46 +09:00
Sameer Kankute
c6101ef977 [Bug]: Add Custom CA certificates to boto3 clients 2026-01-09 12:30:36 +05:30
Yuta Saito
022db6c9ed feat: add mcp registry 2026-01-09 15:07:39 +09:00
yuneng-jiang
4d28359608 e2e refactoring 2026-01-08 21:50:19 -08:00
yuneng-jiang
bcbf8d1de3 Adding unit test to expand unit testing coverage 2026-01-08 20:23:54 -08:00
Sameer Kankute
d9b275e62a
Merge pull request #18806 from BerriAI/litellm_vertex_ai_api_key_support
[FEAT]: Add support for Vertex AI API keys
2026-01-09 09:44:36 +05:30
YutaSaito
c81ac6cf46
Merge pull request #18841 from BerriAI/litellm_fix_cloudzero_db
[fix] how to execute cloudzero sql
2026-01-09 12:37:07 +09:00
Yuta Saito
48bc5ccb4f fix: test 2026-01-09 11:23:47 +09:00
YutaSaito
e678540843
Merge pull request #18836 from drorIvry/main
feat: added qualifire eval webhook
2026-01-09 11:06:45 +09:00
Yuta Saito
f129f598a0 fix: how to execute cloudzero sql 2026-01-09 10:52:48 +09:00
YutaSaito
c27bfddca0
Merge pull request #18837 from BerriAI/litellm_docs_focus
[docs] add focus
2026-01-09 08:00:20 +09:00
Yuta Saito
c38294dc16 docs: add focus 2026-01-09 07:55:55 +09:00
YutaSaito
661f03058c
Merge pull request #18802 from BerriAI/litellm_feat_focus_backend
[feat] Focus export support
2026-01-09 07:21:04 +09:00
Dror Ivry
e6c41c8f47
docs 2026-01-09 00:08:47 +02:00
Dror Ivry
5793f8b866
docs 2026-01-09 00:08:03 +02:00
Dror Ivry
8ff4cb89e1
feat: added qualifire eval webhook 2026-01-09 00:03:26 +02:00
Yuta Saito
844577f2d4 refactor: lazy-load focus export engine and isolate polars deps 2026-01-09 06:39:24 +09:00
yuneng-jiang
1d19974737
Merge pull request #18835 from BerriAI/litellm_ui_build_fix_00
[Infra] Fixing UI Build
2026-01-08 13:12:56 -08:00
yuneng-jiang
9c93882365 fixing build 2026-01-08 13:03:51 -08:00
yuneng-jiang
ae26d8e68a
Merge pull request #18790 from BerriAI/litellm_key_team_routing_3
[Feature] Key and Team Router Setting
2026-01-08 12:41:23 -08:00
Yuta Saito
cc3b068f22 fix: mypy error 2026-01-09 05:35:15 +09:00
yuneng-jiang
02eec19a1f Merge remote-tracking branch 'origin' into litellm_user_promethus_metrics 2026-01-08 10:39:46 -08:00
yuneng-jiang
1b9c7deec6 Merge remote-tracking branch 'origin' into litellm_key_team_routing_3 2026-01-08 10:39:12 -08:00
yuneng-jiang
864e8c6543
Merge pull request #18775 from BerriAI/litellm_fs_callback_fix
[Fix] Normalize Proxy Config Callback
2026-01-08 10:37:21 -08:00
yuneng-jiang
8acb9bf366
Merge pull request #18661 from Chesars/litellm_ui_custom_proxy_base_url
feat(ui): add custom proxy base URL support to Playground
2026-01-08 10:26:37 -08:00
Harshit Jain
516e4f8b96
fix: proactive RDS IAM token refresh to prevent 15-min connection failed (#18795)
* fix: proactive RDS IAM token refresh to prevent 15-min connection failures (#16220)

* fix: add noqa for PLR0915 in proxy_startup_event
2026-01-08 23:53:36 +05:30
Cesar Garcia
86b71d4713
fix(workflow): Update issue labeling with working regex pattern (#18821)
* fix: align max_tokens with max_output_tokens for consistency

Fixed inconsistent max_tokens definitions in model_prices_and_context_window.json.
According to LiteLLM convention, max_tokens should equal max_output_tokens when available.

Models fixed:
- deepseek-chat: 131072 → 8192 (now equals max_output_tokens)
- dashscope/qwen-flash: 1000000 → 32768 (now equals max_output_tokens)
- databricks/databricks-gemma-3-12b: 128000 → 32000 (now equals max_output_tokens)

This ensures consistency across all providers where max_tokens represents
the maximum number of tokens that can be generated in the output.

* fix(workflow): Update issue labeling with working regex pattern

- Replace contains() with regex pattern using \s* for flexible whitespace matching
- Consolidate 4 separate steps into single unified component labeling step
- Tested and verified pattern works for all components: SDK, Proxy, UI Dashboard, Docs
- Pattern handles GitHub's issue body formatting with ### headers and variable newlines
2026-01-08 23:48:41 +05:30
Cesar Garcia
7743c739a3
docs: fix PDF documentation inconsistency in Anthropic page (#18816)
Updated description to match the code example which uses `file`
content type with `file_data` field, instead of incorrectly
mentioning `image_url`.
2026-01-08 23:46:17 +05:30
Cesar Garcia
2ef8bbdf6a
fix: add xiaomi_mimo to LlmProviders enum to fix router support (#18819)
Added XIAOMI_MIMO to the LlmProviders enum in types/utils.py.
The provider was already configured in providers.json but was
missing from the enum, causing "Unsupported provider" errors
when using it in Router/Proxy configurations.

Also added comprehensive unit tests to prevent regression.
2026-01-08 23:45:57 +05:30
Cesar Garcia
1c1ee8de46
Mask extra header secrets in model info (#18822) 2026-01-08 23:42:05 +05:30
Chongshun
60edf13a21
feat(tag-routing): support toggling tag matching between ANY and ALL (#18776) 2026-01-08 23:39:03 +05:30
Harshit Jain
1d296a990c
fix: add idx on LOWER(user_email) for faster duplicate email checks log(n) B tree approach (#18828) 2026-01-08 23:36:08 +05:30