scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-20 00:11:50 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 76
26264 commits 2552 branches 1411 tags 3.1 GiB
Commit graph

26264 commits

This branch
This branch
All branches
Author SHA1 Message Date
Krish Dholakia
f97b0e182a
Merge branch 'main' into fix/mcp-call-tool-context 2025-10-09 22:17:34 -07:00
Alexsander Hamir
1c7463f42f
[Perf]: optimize SSL/TLS handshake performance with prioritized cipher (#15398) 
* perf: optimize SSL/TLS handshake performance with prioritized cipher suites

Add configurable SSL cipher suite list that strongly prefers fast modern
ciphers (TLS 1.3, ECDHE+GCM) while maintaining backward compatibility with
widely-supported fallback ciphers. Set minimum TLS version to 1.2 for
better performance.

Changes:
- Add DEFAULT_SSL_CIPHERS constant with prioritized cipher list
  (configurable via LITELLM_SSL_CIPHERS env var)
- Update get_ssl_configuration() to apply optimized ciphers by default
- Set TLS minimum version to 1.2
- Preserve existing ssl_security_level parameter for custom configs

This balances handshake performance (~50-100ms with modern ciphers) with
broad provider compatibility.

* fix: missing documented constants
 2025-10-09 19:21:37 -07:00
Ishaan Jaff
52bbabd788
[Feat] Support for Vertex AI Gemma Models on Custom Endpoints (#15397) 
* TestVertexGemmaiCompletion

* test vertex Gemma

* fix file name

* fix file naming

* add VertexAIGemmaModels

* add cost_router for vertexai

* fix main.py

* fix VertexGemmaConfig

* fix Vertex AI Gemma-AI Models Handler

* docs gemma

* fix ids

* test fix

* ruff check fixes

* docs fix

* docs fix
 2025-10-09 19:20:02 -07:00
Alexsander Hamir
76a614bc76
fix: remove panic from hot path (#15396) 2025-10-09 18:43:44 -07:00
Ishaan Jaff
4827e62a21
Fix - OpenRouter cache_control to only apply to last content block (#15395) 
* fix: _move_cache_control_to_content

* test_openrouter_transform_request_with_cache_control_list_content

* fix code QA check

* fix: mypy lint

* fix handlers

* fix mypy

* fix - refactor code, fixes for QA checks
 2025-10-09 18:01:33 -07:00
ashengstd
2686156c37
temporarily relax ResponsesAPIResponse parsing to support custom backends (#15362) 
- Replace `ResponsesAPIResponse(**raw_response_json)` with
  `ResponsesAPIResponse.model_construct(**raw_response_json)`
  to bypass strict Pydantic validation.
- Allows Response API to work with self-hosted or non-strict models
  (e.g., vLLM) without raising literal/type errors.
- This is a temporary, low-risk relaxation to improve compatibility
  with more backend implementations.
 2025-10-09 17:46:10 -07:00
Krish Dholakia
eb0b263532
Merge pull request #15340 from BerriAI/litellm_db_config_accidental_override_fix 
fix: Prevents DB from accidentally overriding config file values if they are empty in DB
 2025-10-09 17:31:59 -07:00
Alexsander Hamir
c7234ba053
[Fix] - Sessions not being shared (#15388) 
* fix: share sessions

* fix: remove limit

* clean up

* fix: add missing consts

* add: E2E test

* fix: remove redefinition of unused verbose_logger

* fix: missing const import
 2025-10-09 16:57:40 -07:00
Ishaan Jaff
ec234abb52
fix - param (#15394) 2025-10-09 16:50:11 -07:00
Ishaan Jaffer
be587363f3 docs fix 2025-10-09 16:28:38 -07:00
Ishaan Jaff
6cf57d85c3
[Feat] Add EnkryptAI Guardrails on LiteLLM (#15390) 
* feat: add EnkryptAIGuardrail

* fix types

* fix EnkryptAIGuardrails

* __all__ = ["EnkryptAIGuardrail"]
fix

* fix EnkryptAIGuardrail

* TestEnkryptAIExtraction

* fix mypy linting

* docs enkrypt ai

* add EnkryptAIGuardrailConfigModel

* fix EnkryptAIGuardrailConfigModel

* fix import struct

* fix EnkryptAIGuardrails
 2025-10-09 16:27:04 -07:00
Emerson Gomes
22df8de01f
Add new Azure AI models with pricing details (#15387) 
Adding missing Azure AI models:

* Phi-4-reasoning
* Phi-4-mini-reasoning
* MAI-DS-R1
 2025-10-09 15:25:22 -07:00
Yuta Saito
2b1c061d35 fix: lint error 2025-10-10 07:24:33 +09:00
Yuta Saito
3035305c76 fix: Ensure MCP client stays open during tool call 2025-10-10 07:15:32 +09:00
Krish Dholakia
7b9897e88f
Merge pull request #15321 from timelfrink/fix/redact-aws-credentials 
fix: redact AWS credentials when redact_user_api_key_info enabled
 2025-10-09 07:26:40 -07:00
Krrish Dholakia
f88e3ebdfa docs: refactor to have function call / computer use / etc. on top level 2025-10-09 07:25:25 -07:00
Tim Elfrink
56b2c914ed Apply isort formatting to router.py imports 2025-10-09 08:13:16 +02:00
Tim Elfrink
02f0b1e83a Merge latest changes from origin/main into fix/redact-aws-credentials 
Resolved import conflict for CustomPricingLiteLLMParams which was moved
from litellm.types.router to litellm.types.utils in main branch.
 2025-10-09 08:12:22 +02:00
Krish Dholakia
e2e0cdde31
Merge pull request #15315 from lcfyi/lcfyi/add-support-for-parallel-tool-calls 
Fix parallel tool calls in the Anthropic passthrough adapter
 2025-10-08 23:01:55 -07:00
Krish Dholakia
4615298ba1
Merge pull request #15336 from BerriAI/litellm_fix_litellm_Param_costing 
Fix litellm_param based costing
 2025-10-08 22:55:41 -07:00
Sameer Kankute
e4b89813a5 Add remaining cost fields 2025-10-09 08:40:06 +05:30
Ishaan Jaffer
763d2f8ccd UI new build 2025-10-08 19:57:33 -07:00
Krish Dholakia
753ce49cdd
Merge pull request #15346 from BerriAI/litellm_dev_10_08_2025_p2 
MCP - specify allowed params per tool
 2025-10-08 19:27:55 -07:00
Krish Dholakia
a02b3caef3
Merge branch 'main' into litellm_dev_10_08_2025_p2 2025-10-08 19:27:24 -07:00
Achintya Rajan
95e71b31a8 Update test_proxy_utils.py 2025-10-08 19:25:54 -07:00
Achintya Rajan
169c1f0f21 moved test to test_proxy_server 2025-10-08 19:24:16 -07:00
Krish Dholakia
94e623fb14
Merge pull request #15236 from BerriAI/litellm_ui_refactor_genesis 
LiteLLM UI Refactor Infrastructure
 2025-10-08 19:19:02 -07:00
Krrish Dholakia
e2b7b05774 docs(mcp.md): document new openapi to mcp tool support 2025-10-08 19:16:22 -07:00
Krish Dholakia
d921df1baf
Merge pull request #15343 from BerriAI/litellm_dev_10_08_2025_p1 
MCP - support converting OpenAPI specs to MCP servers
 2025-10-08 19:10:04 -07:00
Krrish Dholakia
5be198248b fix: fix linting error 2025-10-08 19:07:11 -07:00
Krrish Dholakia
37fdb486d4 refactor: comment out oauth error raising logic for now 2025-10-08 19:06:19 -07:00
Krish Dholakia
8cbc85578e
Merge pull request #15351 from BerriAI/litellm_dev_10_08_2025_p3 
SSO - support EntraID app roles
 2025-10-08 19:04:00 -07:00
Krish Dholakia
adbdf9dae9
Merge pull request #14470 from BerriAI/litellm_dev_09_11_2025_p1 
AzureAD Default credentials - select credential type based on environment
 2025-10-08 19:03:07 -07:00
Krish Dholakia
12a1d081ee
Merge branch 'main' into litellm_dev_09_11_2025_p1 2025-10-08 19:02:58 -07:00
Krrish Dholakia
697f99c1d5 docs: doc improvements 2025-10-08 18:59:00 -07:00
Krrish Dholakia
8eafb7a8fa docs: doc improvements 2025-10-08 18:50:42 -07:00
Krrish Dholakia
ff3f356416 docs(docs/): add app role support to docs 2025-10-08 18:46:28 -07:00
Krrish Dholakia
d28ecbc900 feat(ui_sso.py): support mapping app roles from azure entra id to litellm user roles 
Closes LIT-1228
 2025-10-08 18:45:13 -07:00
Ishaan Jaffer
c4022ade49 test mapped tests MCP 2025-10-08 18:34:30 -07:00
Copilot
4226314096
Add native Responses API support for litellm_proxy provider (#15347) 
* Initial plan

* Add native Responses API support for litellm_proxy provider

Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
 2025-10-08 18:31:26 -07:00
Achintya Rajan
4bebb57611 moved test to test_litellm 2025-10-08 18:28:10 -07:00
Ishaan Jaff
2f42c806cb
[Fix] x-litellm-cache-key header not being returned on cache hit (#15348) 
* fix: x-cache-key

* test_cache_key_in_hidden_params_acompletion

* fix: remove_cache_control_flag_from_messages_and_tools
 2025-10-08 18:10:43 -07:00
Achintya Rajan
ff4eda0ea6 removed unscoped changes (will be added later) 2025-10-08 18:00:15 -07:00
Achintya Rajan
3beb4a0797 added reload to base URL when FF is turned off 2025-10-08 17:54:48 -07:00
Ishaan Jaff
97031dc8ee
Fix - (openrouter): move cache_control to content blocks for claude/gemini (#15345) 
* test_openrouter_transform_request_with_cache_control

* fix CacheControlSupportedModels

* test_openrouter_transform_request_with_cache_control_gemini
 2025-10-08 17:41:04 -07:00
Krrish Dholakia
c97495c5d9 docs(mcp.md): document new allow/disallow tool parameters functionality 2025-10-08 17:39:42 -07:00
Achintya Rajan
825a040524 moved virtual-key-refactor to its own branch 2025-10-08 17:38:42 -07:00
Krrish Dholakia
0b27c361fe feat(mcp/): initial commit raising correct oauth error 2025-10-08 17:33:11 -07:00
Krish Dholakia
0a507c37ea
Merge pull request #15344 from sandeshghanta/patch-1 
Add gpt-5-pro-2025-10-06 to model costs
 2025-10-08 17:23:09 -07:00
Achintya Rajan
2b0df22dc5 next routing, feature flagged via sidebar 2025-10-08 17:07:46 -07:00