Commit graph

29885 commits

Author SHA1 Message Date
Andrés
9768eca33e
fix(azure): add logprobs support for Azure OpenAI GPT-5.2 model (#18856)
* fix(azure): add logprobs support for Azure OpenAI GPT-5 models

Azure OpenAI GPT-5 models (including gpt-5.2) support logprobs
parameters, unlike OpenAI's GPT-5 reasoning models. This fix
overrides the parent class restriction to enable logprobs for Azure.

Changes:
- Override get_supported_openai_params() in AzureOpenAIGPT5Config
- Add "logprobs" and "top_logprobs" to supported params
- Add comprehensive tests for logprobs functionality

Testing:
- Verified with direct Azure API calls to gpt-5.2
- API version: 2025-01-01-preview
- Successfully returns logprobs data

Related: #7974, #4022

* refactor: restrict logprobs support to gpt-5.2 only

Only gpt-5.2 has been verified to support logprobs on Azure.
Other gpt-5 variants (gpt-5, gpt-5.1) have not been tested.

Changes:
- Add conditional check for is_model_gpt_5_2_model()
- Update tests to be specific to gpt-5.2
- Add negative tests for gpt-5 and gpt-5.1
- Update documentation to reflect gpt-5.2 specificity
2026-01-09 22:57:50 +05:30
Cesar Garcia
153fd7ad0a
fix: prevent Prisma migration workflow from running in forks (#18863)
- Add repository check to only run workflow in BerriAI/litellm
- Prevents workflow failures and wasted resources in forked repositories
- Avoids confusion for external contributors
2026-01-09 22:56:32 +05:30
yuneng-jiang
c3c67d445b
Merge pull request #18849 from BerriAI/litellm_e2e_page_routing
[Infra] UI - E2E Test: Refactor Page Settings + Test for Page Navigation
2026-01-09 09:07:25 -08:00
yuneng-jiang
68afc1276e
Merge pull request #18848 from BerriAI/litellm_ui_unit_test_coverage_006
[Infra] UI - Unit Test: Adding Tests to Expand Coverage
2026-01-09 09:07:16 -08:00
Harshit Jain
819468554f
fix(security): prevent expired key plaintext leak in error response (#18860) 2026-01-09 22:27:39 +05:30
Sameer Kankute
c0b05fc47a
Merge pull request #18250 from sjmatta/claude/fix-issue-17910-QBgDq
[Fix] Nova model detection for Bedrock provider (#17910)
2026-01-09 17:30:51 +05:30
Sameer Kankute
be28fcd463
Merge pull request #18858 from raghav-stripe/raghav-add-bedrock-tokencounter
feat: add Bedrock as a backend API for token counting
2026-01-09 17:10:52 +05:30
Sameer Kankute
072e3dcd0c
Merge pull request #18715 from BerriAI/litellm_staging_01_06_2026
Staging 01/06/2026
2026-01-09 17:10:04 +05:30
Sameer Kankute
e7efd51bd7
Merge branch 'main' into litellm_staging_01_06_2026 2026-01-09 17:06:17 +05:30
Sameer Kankute
bb9347207b
Merge pull request #18833 from BerriAI/litellm_staging_01_08_2026
Litellm staging 01 08 2026
2026-01-09 17:04:29 +05:30
Sameer Kankute
844c766c65
Merge pull request #18763 from BerriAI/litellm_staging_01_07_2026
Staging - 01/07/2026
2026-01-09 17:01:58 +05:30
Sameer Kankute
d67b475ba4
Merge pull request #18853 from jutaz/bugfix/unbound-local-error
Fix: Add thought_signatures to VertexGeminiConfig and test
2026-01-09 16:27:12 +05:30
Raghav Jhavar
f5ee89dcf6 fix broken imports 2026-01-09 17:43:23 +07:00
Raghav Jhavar
0bdc411fb7 remove comment 2026-01-09 17:24:33 +07:00
Raghav Jhavar
ba78194ff1 add support for bedrock in token counting api 2026-01-09 17:08:07 +07:00
Sameer Kankute
940138f585
Merge pull request #18629 from akraines/fix/wildcard-routing-errors
fix: Improve error messages and validation for wildcard routing with multiple credentials
2026-01-09 14:51:13 +05:30
Justas Brazauskas
c0ee5da444
Fix: Add thought_signatures to VertexGeminiConfig and test 2026-01-09 10:03:45 +02:00
YutaSaito
0e67fdaef0
Merge pull request #18850 from BerriAI/litellm_feat_mcp-registry
[feat] add mcp registry
2026-01-09 16:16:46 +09:00
Yuta Saito
022db6c9ed feat: add mcp registry 2026-01-09 15:07:39 +09:00
yuneng-jiang
4d28359608 e2e refactoring 2026-01-08 21:50:19 -08:00
yuneng-jiang
bcbf8d1de3 Adding unit test to expand unit testing coverage 2026-01-08 20:23:54 -08:00
Sameer Kankute
d9b275e62a
Merge pull request #18806 from BerriAI/litellm_vertex_ai_api_key_support
[FEAT]: Add support for Vertex AI API keys
2026-01-09 09:44:36 +05:30
YutaSaito
c81ac6cf46
Merge pull request #18841 from BerriAI/litellm_fix_cloudzero_db
[fix] how to execute cloudzero sql
2026-01-09 12:37:07 +09:00
Yuta Saito
48bc5ccb4f fix: test 2026-01-09 11:23:47 +09:00
YutaSaito
e678540843
Merge pull request #18836 from drorIvry/main
feat: added qualifire eval webhook
2026-01-09 11:06:45 +09:00
Yuta Saito
f129f598a0 fix: how to execute cloudzero sql 2026-01-09 10:52:48 +09:00
YutaSaito
c27bfddca0
Merge pull request #18837 from BerriAI/litellm_docs_focus
[docs] add focus
2026-01-09 08:00:20 +09:00
Yuta Saito
c38294dc16 docs: add focus 2026-01-09 07:55:55 +09:00
YutaSaito
661f03058c
Merge pull request #18802 from BerriAI/litellm_feat_focus_backend
[feat] Focus export support
2026-01-09 07:21:04 +09:00
Dror Ivry
e6c41c8f47
docs 2026-01-09 00:08:47 +02:00
Dror Ivry
5793f8b866
docs 2026-01-09 00:08:03 +02:00
Dror Ivry
8ff4cb89e1
feat: added qualifire eval webhook 2026-01-09 00:03:26 +02:00
Yuta Saito
844577f2d4 refactor: lazy-load focus export engine and isolate polars deps 2026-01-09 06:39:24 +09:00
yuneng-jiang
1d19974737
Merge pull request #18835 from BerriAI/litellm_ui_build_fix_00
[Infra] Fixing UI Build
2026-01-08 13:12:56 -08:00
yuneng-jiang
9c93882365 fixing build 2026-01-08 13:03:51 -08:00
yuneng-jiang
ae26d8e68a
Merge pull request #18790 from BerriAI/litellm_key_team_routing_3
[Feature] Key and Team Router Setting
2026-01-08 12:41:23 -08:00
Yuta Saito
cc3b068f22 fix: mypy error 2026-01-09 05:35:15 +09:00
yuneng-jiang
1b9c7deec6 Merge remote-tracking branch 'origin' into litellm_key_team_routing_3 2026-01-08 10:39:12 -08:00
yuneng-jiang
864e8c6543
Merge pull request #18775 from BerriAI/litellm_fs_callback_fix
[Fix] Normalize Proxy Config Callback
2026-01-08 10:37:21 -08:00
yuneng-jiang
8acb9bf366
Merge pull request #18661 from Chesars/litellm_ui_custom_proxy_base_url
feat(ui): add custom proxy base URL support to Playground
2026-01-08 10:26:37 -08:00
Harshit Jain
516e4f8b96
fix: proactive RDS IAM token refresh to prevent 15-min connection failed (#18795)
* fix: proactive RDS IAM token refresh to prevent 15-min connection failures (#16220)

* fix: add noqa for PLR0915 in proxy_startup_event
2026-01-08 23:53:36 +05:30
Cesar Garcia
86b71d4713
fix(workflow): Update issue labeling with working regex pattern (#18821)
* fix: align max_tokens with max_output_tokens for consistency

Fixed inconsistent max_tokens definitions in model_prices_and_context_window.json.
According to LiteLLM convention, max_tokens should equal max_output_tokens when available.

Models fixed:
- deepseek-chat: 131072 → 8192 (now equals max_output_tokens)
- dashscope/qwen-flash: 1000000 → 32768 (now equals max_output_tokens)
- databricks/databricks-gemma-3-12b: 128000 → 32000 (now equals max_output_tokens)

This ensures consistency across all providers where max_tokens represents
the maximum number of tokens that can be generated in the output.

* fix(workflow): Update issue labeling with working regex pattern

- Replace contains() with regex pattern using \s* for flexible whitespace matching
- Consolidate 4 separate steps into single unified component labeling step
- Tested and verified pattern works for all components: SDK, Proxy, UI Dashboard, Docs
- Pattern handles GitHub's issue body formatting with ### headers and variable newlines
2026-01-08 23:48:41 +05:30
Cesar Garcia
7743c739a3
docs: fix PDF documentation inconsistency in Anthropic page (#18816)
Updated description to match the code example which uses `file`
content type with `file_data` field, instead of incorrectly
mentioning `image_url`.
2026-01-08 23:46:17 +05:30
Cesar Garcia
2ef8bbdf6a
fix: add xiaomi_mimo to LlmProviders enum to fix router support (#18819)
Added XIAOMI_MIMO to the LlmProviders enum in types/utils.py.
The provider was already configured in providers.json but was
missing from the enum, causing "Unsupported provider" errors
when using it in Router/Proxy configurations.

Also added comprehensive unit tests to prevent regression.
2026-01-08 23:45:57 +05:30
Cesar Garcia
1c1ee8de46
Mask extra header secrets in model info (#18822) 2026-01-08 23:42:05 +05:30
Chongshun
60edf13a21
feat(tag-routing): support toggling tag matching between ANY and ALL (#18776) 2026-01-08 23:39:03 +05:30
Harshit Jain
1d296a990c
fix: add idx on LOWER(user_email) for faster duplicate email checks log(n) B tree approach (#18828) 2026-01-08 23:36:08 +05:30
Lucas Rothman
2a138a202f
fix: properly use litellm api keys (#18832) 2026-01-08 23:32:47 +05:30
Constantine
3ebec39b74
fix(proxy): use async anthropic client to prevent event loop blocking (#18435)
Fixes #16716.
Previously, synchronous Anthropic client was used for token counting, which blocked the event loop.
This change switches to AsyncAnthropic and caches the client instance.
2026-01-08 23:26:46 +05:30
Cesar Garcia
cfda03ebe1
fix(gemini): support snake_case for google_search tool parameters (#18451)
* fix(gemini): support snake_case for google_search tool parameters

Add snake_case aliases for Gemini tool names to match the pattern
already used by other tools (url_context, google_maps, code_execution):
- google_search -> googleSearch
- google_search_retrieval -> googleSearchRetrieval
- enterprise_web_search -> enterpriseWebSearch

* test(gemini): add tests for snake_case google_search tool aliases

* refactor(gemini): simplify get_tool_value calls formatting
2026-01-08 23:25:36 +05:30