Commit graph

31338 commits

Author SHA1 Message Date
yuneng-jiang
71a2fc5331 fix classnames 2026-01-20 14:16:03 -08:00
Cesar Garcia
7515f179e7
fix: sync Helm chart version with LiteLLM release version (#19438)
Replace independent auto-incrementing chart versioning with 1-1 sync
to LiteLLM version. This allows users to easily map Helm chart versions
to LiteLLM versions without needing to inspect appVersion.

Changes:
- Remove auto-increment logic that read from OCI registry
- Chart version now equals LiteLLM tag without 'v' prefix (v1.81.0 -> 1.81.0)
- appVersion equals full Docker tag (v1.81.0)
- Update both ghcr_deploy.yml and ghcr_helm_deploy.yml workflows

Before: helm chart 0.1.837 -> user has to guess LiteLLM version
After:  helm chart 1.81.0  -> matches LiteLLM v1.81.0

References:
- https://codefresh.io/docs/docs/ci-cd-guides/helm-best-practices/
2026-01-20 14:13:26 -08:00
yuneng-jiang
f434d1c847 Option to pre fill custom proxy base URL 2026-01-20 14:07:54 -08:00
Alexsander Hamir
7f81dea8b3
Add custom auth header support and increase default prompt size to 100k chars (#19436) 2026-01-20 13:25:12 -08:00
yuneng-jiang
e142474e0b
Merge pull request #19431 from BerriAI/litellm_ui_fix_build_002
[Infra] UI - Fixing UI Build
2026-01-20 13:17:25 -08:00
yuneng-jiang
3ae71bf49e fixing ui build 2026-01-20 13:03:27 -08:00
Harshit Jain
20323feecc
fix(prompts): fix prompt info lookup and delete using correct IDs (#19358)
* fix(prompts): fix prompt info lookup and delete using correct IDs

* add regression tests cases
2026-01-20 12:28:34 -08:00
yuneng-jiang
bfb94f56b7
Merge pull request #19276 from stiyyagura0901/litellm_fix_ui_auth_header_override
fix: UI dashboard respects custom authentication header override
2026-01-20 12:24:14 -08:00
Alexsander Hamir
5a06868652
Fix in-flight request termination on SIGTERM when health-check runs in a separate process (#19427) 2026-01-20 12:17:06 -08:00
Kris Xia
56bf6001e9
Supports setting media_resolution and fps parameters on each video file, when using Gemini video understanding. (#19273)
* feat: add gemini video metadata and detail support

Implement support for video_metadata and enhanced detail parameter
for Gemini 3.0+ models:

- Add video_metadata field to ChatCompletionFileObjectFile type
  - Supports fps, start_offset, and end_offset parameters
  - Properly converts snake_case to camelCase for Gemini API
- Extend detail parameter to support medium and ultra_high levels
  - Maps to MEDIA_RESOLUTION_MEDIUM and MEDIA_RESOLUTION_ULTRA_HIGH
- Update _process_gemini_image to handle video metadata transformation
- Add version gating to only apply features for Gemini 3+ models
- Add comprehensive test coverage (6 new test cases)
  - Test detail parameter with file objects
  - Test video_metadata fields (fps, start_offset, end_offset)
  - Test combined detail + video_metadata usage
  - Test new detail levels (medium, ultra_high)
  - Test version gating (Gemini 1.5 vs 3.0)

Note: video_metadata is only supported for video files but error
handling is delegated to Vertex AI for other media types.

* refactor: rename _process_gemini_image to _process_gemini_media

The function handles multiple media types (images, audio, video, PDF),
not just images. Renamed to better reflect its actual purpose.

- Update function name in transformation.py
- Update all function calls and references
- Update test names and imports to match
- Improve docstring to clarify it handles all media types

* docs: add video metadata and media resolution control documentation

Add comprehensive documentation for Gemini 3+ video processing features:
- Document media resolution control (detail parameter) for images and videos
- Add video_metadata field documentation (fps, start_offset, end_offset)
- Include usage examples with tabs for basic, combined, and proxy scenarios
- Update both Gemini and Vertex AI provider documentation
- Clarify snake_case to camelCase field conversion for Gemini API

Signed-off-by: Kris Xia <xiajiayi0506@gmail.com>

* refactor(gemini): extract metadata application into helper function

Extract duplicated Gemini 3+ media_resolution and video_metadata
application logic from _process_gemini_media into a dedicated
_apply_gemini_3_metadata helper function to improve code maintainability.

---------

Signed-off-by: Kris Xia <xiajiayi0506@gmail.com>
2026-01-20 11:36:55 -08:00
Krrish Dholakia
f95f5563ea docs: document input/output/total tokens behaviour
Closes https://github.com/BerriAI/litellm/issues/17480
2026-01-20 10:45:47 -08:00
Alexsander Hamir
1377721715
Fix: Handle PostgreSQL cached plan errors during rolling deployments (#19424) 2026-01-20 10:44:31 -08:00
Harshit Jain
1c8bf19f1e
fix(proxy_server): pass search_tools to Router during DB-triggered initialization (#19388) 2026-01-20 09:55:09 -08:00
Harshit Jain
75ee0d126c
Fix/prisma schema permission (#19391)
* fix: add prisma permission issue

* Add test case for prisma generate
2026-01-20 09:53:16 -08:00
Otavio Brito
ce37729da4
remove count tokens optional param before request is sent to vertex (#19359) 2026-01-20 09:03:27 -08:00
Ishaan Jaffer
f6d6455cbc fix rc 2026-01-20 08:39:17 -08:00
Sameer Kankute
11dbae85d1
Merge pull request #19390 from BerriAI/litellm_consistent_id_streaming_responses
Fix: ID mismatch between text-start and text-delta
2026-01-20 20:46:34 +05:30
Sameer Kankute
961a424069
Merge pull request #19355 from BerriAI/litellm_staging_01_19_2026
Litellm staging 01 19 2026
2026-01-20 20:45:12 +05:30
Sameer Kankute
9e1275b76c
Merge branch 'main' into litellm_staging_01_19_2026 2026-01-20 19:19:36 +05:30
Sameer Kankute
a3c1f4758d
Merge branch 'main' into litellm_consistent_id_streaming_responses 2026-01-20 19:02:23 +05:30
Sameer Kankute
e69c12b6db
Merge pull request #19396 from BerriAI/litellm_responses_route_fix
Fix for Prometheus Metric Cardinality Issue with /responses Endpoint
2026-01-20 19:01:18 +05:30
Sameer Kankute
bd6f7bae21
Merge pull request #19397 from BerriAI/litellm_google_computer_use_cost_tracking
Add gemini-2.5-computer-use-preview-10-2025 model for vertex ai provider
2026-01-20 19:00:34 +05:30
Sameer Kankute
172ad17fbc
Merge pull request #19398 from BerriAI/litellm_add_multimodal_cost_tracking
Add input_cost_per_video_per_second in ModelInfoBase
2026-01-20 19:00:05 +05:30
Sameer Kankute
37ce6957ab
Merge pull request #19386 from BerriAI/litellm_staging_01_20_2026
Litellm staging 01 20 2026
2026-01-20 18:53:59 +05:30
Sameer Kankute
12c556e485
Merge pull request #19409 from BerriAI/revert-19261-feat/redis-migration-lock-safe
Revert "feat: Add Redis-based migration lock with bug fixes"
2026-01-20 18:46:38 +05:30
Sameer Kankute
3cc19c56ba
Revert "feat: Add Redis-based migration lock with bug fixes (#19261)"
This reverts commit 98e87c3e67.
2026-01-20 18:46:26 +05:30
Sameer Kankute
dc3ee63359 fix: test_env_keys 2026-01-20 18:37:56 +05:30
Sameer Kankute
2153db5e64 fix: test_convert_to_bedrock_format_post_call_streaming_hook 2026-01-20 18:27:36 +05:30
Sameer Kankute
8b24720638 fix: test_standard_logging_payload_includes_guardrail_information 2026-01-20 18:21:32 +05:30
Sameer Kankute
219f650445
Merge pull request #19405 from BerriAI/revert-19315-fix-litellm-params
Revert "fix #19254 - [Bug]: litellm_params ignored by get_llm_provider function in completion() definition"
2026-01-20 17:51:44 +05:30
Sameer Kankute
f6fcd0cb85
Revert "fixed litellm params (#19315)"
This reverts commit 16b8ed6786.
2026-01-20 17:50:45 +05:30
Sameer Kankute
df89e7262a
Merge pull request #19404 from BerriAI/litellm_staging_01_20_2026_fix
Litellm staging 01 20 2026 fix
2026-01-20 17:40:23 +05:30
Sameer Kankute
cd96c8cbb0 Fix:test_aaaaazure_tenant_id_auth 2026-01-20 17:39:08 +05:30
Sameer Kankute
f0785d5a51 Fix:test_supported_params_limited_to_docs 2026-01-20 17:26:40 +05:30
Sameer Kankute
c8ad14dbab
Merge pull request #19402 from BerriAI/revert-19371-feat/configurable-retry-logic
Revert "feat: add retry_delay, exponential_backoff, and jitter to completion()"
2026-01-20 17:07:11 +05:30
Sameer Kankute
ae414ed462
Revert "feat: add retry_delay, exponential_backoff, and jitter to completion(…"
This reverts commit 1678f621db.
2026-01-20 17:07:00 +05:30
Sameer Kankute
dd6b35e825
Merge pull request #19401 from BerriAI/main
Merge main 01 20 2026
2026-01-20 16:45:08 +05:30
Sameer Kankute
deb9142117
Merge pull request #19400 from BerriAI/main
merge main iin 19/1 staging
2026-01-20 16:45:01 +05:30
Sameer Kankute
be0f61854f Add input_cost_per_video_per_second in ModelInfoBase 2026-01-20 16:23:47 +05:30
Sameer Kankute
cebcad48d3 Add gemini-2.5-computer-use-preview-10-2025 model for vertex ai provider 2026-01-20 15:53:02 +05:30
Sameer Kankute
5f80e8d5e8 Fix for Prometheus Metric Cardinality Issue with /responses Endpoint 2026-01-20 15:28:09 +05:30
Sameer Kankute
f945fd9a84 Fix: ID mismatch between text-start and text-delta 2026-01-20 11:15:37 +05:30
Sameer Kankute
3eb3594ab7
Merge pull request #19346 from Chesars/fix/drop-params-prompt-cache-key-19225
fix: drop_params not dropping prompt_cache_key for non-OpenAI providers
2026-01-20 10:15:45 +05:30
Sameer Kankute
931998f170
Merge pull request #19266 from VedantMadane/fix-prompt-caching-string-content
Fix extract_cacheable_prefix to handle string content with message-level cache_control
2026-01-20 10:11:48 +05:30
victorigualada
7d6d419a67
fix: preserve tool output ordering for gemini in responses bridge (#19360)
* fix: preserve tool output ordering for gemini in responses bridge

- Keep function_call_output adjacent to its function_call when building chat messages
- Normalize function_call_output.output lists (input_* parts) into tool message content

* fix test

* small improvements
2026-01-19 20:37:59 -08:00
Igal Boxerman
d7ac8de832
docs: Migrate Pillar Security to Generic Guardrail API (#19364)
Update Pillar Security integration to use the generic_guardrail_api
instead of the dedicated pillar guardrail type. This aligns with
the Generic Guardrail API specification introduced in previous PRs.

Changes:
- Rewrite pillar_security.md with new generic_guardrail_api config
- Add Pillar Security example to generic_guardrail_api.md
- Add Pillar Security to quick_start.md guardrails examples

Related PRs: #17175, #18647, #18932, #19023
2026-01-19 20:35:56 -08:00
victorigualada
581d086c20
fix(responses): stream tool call events in completion bridge (#19368)
Emit Responses API streaming events for tool calls when the underlying chat stream contains tool_call deltas, and recover tool calls into the stream when they only appear in the final response.
2026-01-19 20:29:50 -08:00
Sameer Kankute
2ae308028d
Merge pull request #18787 from aproorg/fix/bedrock-thinking-tool-call-2
fix(bedrock): handle thinking with tool calls for Claude 4 models
2026-01-20 09:43:07 +05:30
YutaSaito
00814d4d90
Merge pull request #19379 from BerriAI/litellm_feat_mcp_version_up
[feat] mcp version up
2026-01-20 13:09:29 +09:00
Sameer Kankute
a4bfdf2427 Fix: total timeout is not respected 2026-01-20 09:37:43 +05:30