Commit graph

26259 commits

Author SHA1 Message Date
Alexsander Hamir
76a614bc76
fix: remove panic from hot path (#15396) 2025-10-09 18:43:44 -07:00
Ishaan Jaff
4827e62a21
Fix - OpenRouter cache_control to only apply to last content block (#15395)
* fix: _move_cache_control_to_content

* test_openrouter_transform_request_with_cache_control_list_content

* fix code QA check

* fix: mypy lint

* fix handlers

* fix mypy

* fix - refactor code, fixes for QA checks
2025-10-09 18:01:33 -07:00
ashengstd
2686156c37
temporarily relax ResponsesAPIResponse parsing to support custom backends (#15362)
- Replace `ResponsesAPIResponse(**raw_response_json)` with
  `ResponsesAPIResponse.model_construct(**raw_response_json)`
  to bypass strict Pydantic validation.
- Allows Response API to work with self-hosted or non-strict models
  (e.g., vLLM) without raising literal/type errors.
- This is a temporary, low-risk relaxation to improve compatibility
  with more backend implementations.
2025-10-09 17:46:10 -07:00
Krish Dholakia
eb0b263532
Merge pull request #15340 from BerriAI/litellm_db_config_accidental_override_fix
fix: Prevents DB from accidentally overriding config file values if they are empty in DB
2025-10-09 17:31:59 -07:00
Alexsander Hamir
c7234ba053
[Fix] - Sessions not being shared (#15388)
* fix: share sessions

* fix: remove limit

* clean up

* fix: add missing consts

* add: E2E test

* fix: remove redefinition of unused verbose_logger

* fix: missing const import
2025-10-09 16:57:40 -07:00
Ishaan Jaff
ec234abb52
fix - param (#15394) 2025-10-09 16:50:11 -07:00
Ishaan Jaffer
be587363f3 docs fix 2025-10-09 16:28:38 -07:00
Ishaan Jaff
6cf57d85c3
[Feat] Add EnkryptAI Guardrails on LiteLLM (#15390)
* feat: add EnkryptAIGuardrail

* fix types

* fix EnkryptAIGuardrails

* __all__ = ["EnkryptAIGuardrail"]
fix

* fix EnkryptAIGuardrail

* TestEnkryptAIExtraction

* fix mypy linting

* docs enkrypt ai

* add EnkryptAIGuardrailConfigModel

* fix EnkryptAIGuardrailConfigModel

* fix import struct

* fix EnkryptAIGuardrails
2025-10-09 16:27:04 -07:00
Emerson Gomes
22df8de01f
Add new Azure AI models with pricing details (#15387)
Adding missing Azure AI models:

* Phi-4-reasoning
* Phi-4-mini-reasoning
* MAI-DS-R1
2025-10-09 15:25:22 -07:00
Krish Dholakia
7b9897e88f
Merge pull request #15321 from timelfrink/fix/redact-aws-credentials
fix: redact AWS credentials when redact_user_api_key_info enabled
2025-10-09 07:26:40 -07:00
Krrish Dholakia
f88e3ebdfa docs: refactor to have function call / computer use / etc. on top level 2025-10-09 07:25:25 -07:00
Tim Elfrink
56b2c914ed Apply isort formatting to router.py imports 2025-10-09 08:13:16 +02:00
Tim Elfrink
02f0b1e83a Merge latest changes from origin/main into fix/redact-aws-credentials
Resolved import conflict for CustomPricingLiteLLMParams which was moved
from litellm.types.router to litellm.types.utils in main branch.
2025-10-09 08:12:22 +02:00
Krish Dholakia
e2e0cdde31
Merge pull request #15315 from lcfyi/lcfyi/add-support-for-parallel-tool-calls
Fix parallel tool calls in the Anthropic passthrough adapter
2025-10-08 23:01:55 -07:00
Krish Dholakia
4615298ba1
Merge pull request #15336 from BerriAI/litellm_fix_litellm_Param_costing
Fix litellm_param based costing
2025-10-08 22:55:41 -07:00
Sameer Kankute
e4b89813a5 Add remaining cost fields 2025-10-09 08:40:06 +05:30
Ishaan Jaffer
763d2f8ccd UI new build 2025-10-08 19:57:33 -07:00
Krish Dholakia
753ce49cdd
Merge pull request #15346 from BerriAI/litellm_dev_10_08_2025_p2
MCP - specify allowed params per tool
2025-10-08 19:27:55 -07:00
Krish Dholakia
a02b3caef3
Merge branch 'main' into litellm_dev_10_08_2025_p2 2025-10-08 19:27:24 -07:00
Achintya Rajan
95e71b31a8 Update test_proxy_utils.py 2025-10-08 19:25:54 -07:00
Achintya Rajan
169c1f0f21 moved test to test_proxy_server 2025-10-08 19:24:16 -07:00
Krish Dholakia
94e623fb14
Merge pull request #15236 from BerriAI/litellm_ui_refactor_genesis
LiteLLM UI Refactor Infrastructure
2025-10-08 19:19:02 -07:00
Krrish Dholakia
e2b7b05774 docs(mcp.md): document new openapi to mcp tool support 2025-10-08 19:16:22 -07:00
Krish Dholakia
d921df1baf
Merge pull request #15343 from BerriAI/litellm_dev_10_08_2025_p1
MCP - support converting OpenAPI specs to MCP servers
2025-10-08 19:10:04 -07:00
Krrish Dholakia
5be198248b fix: fix linting error 2025-10-08 19:07:11 -07:00
Krrish Dholakia
37fdb486d4 refactor: comment out oauth error raising logic for now 2025-10-08 19:06:19 -07:00
Krish Dholakia
8cbc85578e
Merge pull request #15351 from BerriAI/litellm_dev_10_08_2025_p3
SSO - support EntraID app roles
2025-10-08 19:04:00 -07:00
Krish Dholakia
adbdf9dae9
Merge pull request #14470 from BerriAI/litellm_dev_09_11_2025_p1
AzureAD Default credentials - select credential type based on environment
2025-10-08 19:03:07 -07:00
Krish Dholakia
12a1d081ee
Merge branch 'main' into litellm_dev_09_11_2025_p1 2025-10-08 19:02:58 -07:00
Krrish Dholakia
697f99c1d5 docs: doc improvements 2025-10-08 18:59:00 -07:00
Krrish Dholakia
8eafb7a8fa docs: doc improvements 2025-10-08 18:50:42 -07:00
Krrish Dholakia
ff3f356416 docs(docs/): add app role support to docs 2025-10-08 18:46:28 -07:00
Krrish Dholakia
d28ecbc900 feat(ui_sso.py): support mapping app roles from azure entra id to litellm user roles
Closes LIT-1228
2025-10-08 18:45:13 -07:00
Ishaan Jaffer
c4022ade49 test mapped tests MCP 2025-10-08 18:34:30 -07:00
Copilot
4226314096
Add native Responses API support for litellm_proxy provider (#15347)
* Initial plan

* Add native Responses API support for litellm_proxy provider

Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
2025-10-08 18:31:26 -07:00
Achintya Rajan
4bebb57611 moved test to test_litellm 2025-10-08 18:28:10 -07:00
Ishaan Jaff
2f42c806cb
[Fix] x-litellm-cache-key header not being returned on cache hit (#15348)
* fix: x-cache-key

* test_cache_key_in_hidden_params_acompletion

* fix: remove_cache_control_flag_from_messages_and_tools
2025-10-08 18:10:43 -07:00
Achintya Rajan
ff4eda0ea6 removed unscoped changes (will be added later) 2025-10-08 18:00:15 -07:00
Achintya Rajan
3beb4a0797 added reload to base URL when FF is turned off 2025-10-08 17:54:48 -07:00
Ishaan Jaff
97031dc8ee
Fix - (openrouter): move cache_control to content blocks for claude/gemini (#15345)
* test_openrouter_transform_request_with_cache_control

* fix CacheControlSupportedModels

* test_openrouter_transform_request_with_cache_control_gemini
2025-10-08 17:41:04 -07:00
Krrish Dholakia
c97495c5d9 docs(mcp.md): document new allow/disallow tool parameters functionality 2025-10-08 17:39:42 -07:00
Achintya Rajan
825a040524 moved virtual-key-refactor to its own branch 2025-10-08 17:38:42 -07:00
Krrish Dholakia
0b27c361fe feat(mcp/): initial commit raising correct oauth error 2025-10-08 17:33:11 -07:00
Krish Dholakia
0a507c37ea
Merge pull request #15344 from sandeshghanta/patch-1
Add gpt-5-pro-2025-10-06 to model costs
2025-10-08 17:23:09 -07:00
Achintya Rajan
2b0df22dc5 next routing, feature flagged via sidebar 2025-10-08 17:07:46 -07:00
Pierre-Emmanuel MERCIER
861750790b feat: add redis ssl and username support (#11319) 2025-10-08 16:48:07 -07:00
Sandesh Ghanta
e4317030bf
Add gpt-5-pro-2025-10-06 to model costs 2025-10-08 16:44:40 -07:00
Krrish Dholakia
ecb6c0e814 fix(mcp_server_manager.py): ensure only allowed params sent to MCP server 2025-10-08 16:37:50 -07:00
Krrish Dholakia
dd4249db78 feat(mcp_server_manager.py): initial commit adding allowed params support
allow admin to specify which parameters to allow/disallow by MCP tool
2025-10-08 16:27:01 -07:00
Krish Dholakia
5c6fb5eb29
Merge pull request #15309 from BerriAI/litellm_cookie_spasm_mitigation
potentially fixes a UI spasm issue with an expired cookie
2025-10-08 16:13:38 -07:00