scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-05 08:07:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 136
31779 commits 4051 branches 1400 tags 4.1 GiB
Commit graph

31779 commits

This branch
This branch
All branches
Author SHA1 Message Date
michelligabriele
7d5439adda
fix(bedrock): support tool search header translation for Sonnet 4.5 (#19871) 
Extend advanced-tool-use header translation to include Claude Sonnet 4.5
in addition to Opus 4.5 on Bedrock Invoke API.

When Claude Code sends the advanced-tool-use-2025-11-20 header, it now
gets correctly translated to Bedrock-specific headers for both:
- Claude Opus 4.5
- Claude Sonnet 4.5

Headers translated:
- tool-search-tool-2025-10-19
- tool-examples-2025-10-29

Fixes defer_loading validation error on Bedrock with Sonnet 4.5.

Ref: https://platform.claude.com/docs/en/agents-and-tools/tool-use/tool-search-tool
 2026-01-27 12:17:09 -08:00
Milan
3f99a91a47 initialize tiktoken environment at import time to support offline usage 2026-01-27 22:05:04 +02:00
jayy-77
b20cf7dfa9 test: add comprehensive tests for User-Agent customization 
Add 8 tests covering:
- Default User-Agent behavior
- Disabling default User-Agent
- Custom User-Agent via extra_headers
- Environment variable support
- Async handler support
- Override without disabling
- Claude Code use case
- Backwards compatibility
 2026-01-28 00:50:04 +05:30
jayy-77
a14703eb17 refactor: update HTTP handlers to respect disable_default_user_agent 
Modify http_handler.py and httpx_handler.py to check the
disable_default_user_agent flag and return empty headers when disabled.
This allows users to override the User-Agent header completely.
 2026-01-28 00:50:02 +05:30
jayy-77
fe184936ff feat: add disable_default_user_agent flag 
Add litellm.disable_default_user_agent global flag to control whether
the automatic User-Agent header is injected into HTTP requests.
 2026-01-28 00:49:52 +05:30
yuneng-jiang
45954155d7
Merge pull request #19799 from BerriAI/litellm_sso_email_casing 
[Fix] SSO Email Case Sensitivity
 2026-01-27 09:52:03 -08:00
yuneng-jiang
50612715a5
Merge pull request #19814 from BerriAI/litellm_team_member_add_fix 
[Fix] /team/member_add User Email and ID Verifications
 2026-01-27 09:49:01 -08:00
michelligabriele
388b4c90b6
fix(proxy): handle agent parameter in /interactions endpoint (#19866) 2026-01-27 09:34:58 -08:00
michelligabriele
fc7a9b4cb0
fix(enterprise): correct error message for DISABLE_ADMIN_ENDPOINTS (#19861) 
The error message for DISABLE_ADMIN_ENDPOINTS incorrectly said
"DISABLING LLM API ENDPOINTS is an Enterprise feature" instead of
"DISABLING ADMIN ENDPOINTS is an Enterprise feature".

This was a copy-paste bug from the is_llm_api_route_disabled() function.

Added regression tests to verify both error messages are correct.
 2026-01-27 09:34:30 -08:00
Harshit Jain
0f0b71e6d9
feat: add feature to make silent calls (#19544) 
* feat: add feature to make silent calls

* add test or silent feat

* add docs for silent feat

* fix lint issues and  UI logs

* add docs of ab testing and deep copy
 2026-01-27 09:16:53 -08:00
Sameer Kankute
5c1588e3b7
Merge pull request #19841 from BerriAI/litellm_bedrock_tool_search_header 
Translate advanced-tool-use to Bedrock-specific headers for Claude Opus 4.5
 2026-01-27 17:48:51 +05:30
Sameer Kankute
81020d05d2
Merge pull request #19844 from BerriAI/litellm_sarvam_doc 
[Docs]Add sarvam usage documentation
 2026-01-27 17:47:59 +05:30
Sameer Kankute
c8a93c7d81
Merge pull request #19845 from BerriAI/litellm_gemini-robotics-er-1.5-preview2 
Add  Gemini Robotics-ER 1.5 preview support
 2026-01-27 17:47:44 +05:30
Sameer Kankute
8565a9f5a2
Merge pull request #19847 from BerriAI/litellm_image_streaming_download 
Fix: Stream the download in chunks for image handling
 2026-01-27 17:47:35 +05:30
Sameer Kankute
29fc4f8f61
Merge pull request #19850 from BerriAI/litellm_grok_reasonnig_support 
Add grok reasoning content
 2026-01-27 17:46:07 +05:30
Sameer Kankute
c834d7d1fe
Merge branch 'main' into litellm_oss_staging_01_27_2026 2026-01-27 17:11:15 +05:30
Sameer Kankute
ea0a264a3c
Merge pull request #19753 from BerriAI/litellm_oss_staging_01_26_2026 
fix(proxy): support slashes in google generateContent model names (#1…
 2026-01-27 17:09:12 +05:30
Sameer Kankute
0214cb04cd
Merge branch 'main' into litellm_oss_staging_01_26_2026 2026-01-27 17:00:58 +05:30
Sameer Kankute
adf6d7e1db
Merge pull request #19692 from BerriAI/litellm_oss_staging_01_24_2026 
Litellm oss staging 01 24 2026
 2026-01-27 16:59:28 +05:30
Sameer Kankute
9a2750f8ec
Merge pull request #19617 from BerriAI/litellm_oss_staging_01_23_2026 
Litellm oss staging 01 23 2026
 2026-01-27 16:55:32 +05:30
Sameer Kankute
f30742fe6e Fix mypy and code quality issues 2026-01-27 16:49:39 +05:30
Sameer Kankute
154ad179af Revert poetry lock 2026-01-27 16:39:56 +05:30
Sameer Kankute
e695cb5367 Add grok reasoning content 2026-01-27 16:34:57 +05:30
Sameer Kankute
bd95712a22
Merge pull request #19832 from BerriAI/litellm_fix_a2a_package 
Fix: A2A Python SDK URL
 2026-01-27 15:16:52 +05:30
Sameer Kankute
988dd2a911 Fix: Stream the download in chunks 2026-01-27 14:35:54 +05:30
Sameer Kankute
e273c85848 Add gemini-robotics-er-1.5-preview model documentation 2026-01-27 13:58:13 +05:30
Sameer Kankute
cf012a2f65 Add gemini-robotics-er-1.5-preview model in model map 2026-01-27 13:58:03 +05:30
Sameer Kankute
faf9c9ba76 Add sarvam doc 2026-01-27 13:11:29 +05:30
Sameer Kankute
13313ac2be
Merge pull request #19232 from natimofeev/fix-gigachat-function-output-format 
Fix: ensure function content is valid JSON for GigaChat
 2026-01-27 13:02:38 +05:30
Sameer Kankute
f98eba24d4
Merge pull request #19040 from Point72/ephrimstanley/batch-list 
Fix /batches to return encoded ids (from managed objects table)
 2026-01-27 13:02:05 +05:30
Sameer Kankute
9883c2fd64 Fix: timeout exception raised eror 2026-01-27 12:32:37 +05:30
Harshit Jain
fd2f148161
fix: resolve 'does not exist' migration errors as applied in setup_database (#19281) 2026-01-26 22:11:36 -08:00
Harshit Jain
a5bc98a18a
fix(prometheus): safely handle None metadata in logging to prevent At… (#19691) 
* fix(prometheus): safely handle None metadata in logging to prevent AttributeError

* fix: lint issues
 2026-01-26 22:10:54 -08:00
Harshit Jain
885a02e6c8
fix: token calculations and refactor (#19696) 2026-01-26 22:08:17 -08:00
Sameer Kankute
3f32562587 Translate advanced-tool-use to Bedrock-specific headers for Claude Opus 4.5 2026-01-27 11:20:16 +05:30
Sameer Kankute
1bf33c4e41 Fix:Support both JSON array format and comma-separated values from user headers 2026-01-27 11:19:31 +05:30
Cesar Garcia
e4a557d95f
fix(xai): correct cached token cost calculation for xAI models (#19772) 
* fix(azure): use generic cost calculator for audio token pricing

Azure audio models were charging audio output tokens at the text token
rate instead of the correct audio token rate. This resulted in costs
being ~6.65x lower than expected.

The fix replaces Azure's custom cost calculation logic with the generic
cost calculator that properly handles text, audio, cached, reasoning,
and image tokens.

Fixes #19764

* fix(xai): correct cached token cost calculation for xAI models

- Fix double-counting issue where xAI reports text_tokens = prompt_tokens
  (including cached), causing tokens to be charged twice
- Add cache_read_input_token_cost to xAI grok-3 and grok-3-mini model variants
- Detection: when text_tokens + cached_tokens > prompt_tokens, recalculate
  text_tokens = prompt_tokens - cached_tokens

xAI pricing (25% of input for cached):
- grok-3 variants: $0.75/M cached (input $3/M)
- grok-3-mini variants: $0.075/M cached (input $0.30/M)
 2026-01-26 21:00:35 -08:00
Cesar Garcia
16f456ad82
fix(azure): use generic cost calculator for audio token pricing (#19771) 
Azure audio models were charging audio output tokens at the text token
rate instead of the correct audio token rate. This resulted in costs
being ~6.65x lower than expected.

The fix replaces Azure's custom cost calculation logic with the generic
cost calculator that properly handles text, audio, cached, reasoning,
and image tokens.

Fixes #19764
 2026-01-26 21:00:03 -08:00
Cesar Garcia
b1968a8e33
fix(responses): update local_vars with detected provider (#19782) (#19798) 
When using the responses API with provider-specific params (aws_*, vertex_*)
without explicitly passing custom_llm_provider, the code crashed with:
AttributeError: 'NoneType' object has no attribute 'startswith'

Root cause: local_vars was captured via locals() before get_llm_provider()
detected the provider from the model string (e.g., "bedrock/..."), so
custom_llm_provider remained None when processing provider-specific params.

Fix: Update local_vars["custom_llm_provider"] after get_llm_provider() call
so the detected provider is available for param processing.

Affected provider-specific params:
- aws_* (aws_region_name, aws_access_key_id, etc.) for Bedrock/SageMaker
- vertex_* (vertex_project, vertex_location, etc.) for Vertex AI
 2026-01-26 20:47:35 -08:00
Cesar Garcia
0d45b01069
fix(models): set gpt-5.2-codex mode to responses for Azure and OpenRouter (#19770) 
Fixes #19754

The gpt-5.2-codex model only supports the responses API, not chat completions.
Updated azure/gpt-5.2-codex and openrouter/openai/gpt-5.2-codex entries to use
mode: "responses" and supported_endpoints: ["/v1/responses"].
 2026-01-26 20:36:10 -08:00
Krish Dholakia
6a54dcfa93
feat: Add model_id label to Prometheus metrics (#18048) (#19678) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2026-01-26 20:32:08 -08:00
Krish Dholakia
7ba0235a50
Litellm release notes 01 26 2026 (#19838) 
* docs: document new models/endpoints

* docs: cleanup

* feat: update model table

* fix: cleanup
 2026-01-26 20:20:20 -08:00
yuneng-jiang
7307992cea fixing tests 2026-01-26 20:17:53 -08:00
Krish Dholakia
664715b68e
Litellm release notes 01 26 2026 (#19836) 
* docs: document new models/endpoints

* docs: cleanup

* feat: update model table
 2026-01-26 20:11:56 -08:00
yuneng-jiang
0dea6eeea3
Merge pull request #19721 from BerriAI/litellm_ui_bulk_fix 
[Fix] UI - Internal User: Bulk Add
 2026-01-26 20:10:37 -08:00
yuneng-jiang
c875cfb8cb
Merge pull request #19804 from BerriAI/litellm_ui_dark_mode_slider 
[Feature] UI - Add Light/Dark Mode Switch for Development
 2026-01-26 20:10:12 -08:00
yuneng-jiang
a97bf452f1
Merge pull request #19831 from BerriAI/litellm_ui_hide_send_feedback 
[Feature] UI - Feedback Prompts: Option To Hide Prompts
 2026-01-26 20:10:04 -08:00
yuneng-jiang
a7712ff8ef
Merge pull request #19807 from BerriAI/litellm_ui_regen_expiry 
[Fix] UI - Create Key: Expire Key Input Duration
 2026-01-26 20:09:39 -08:00
yuneng-jiang
ef7261d0eb Fixing tests 2026-01-26 20:07:30 -08:00
Cesar Garcia
014f783cc9
docs(readme): add OpenAI Agents SDK to OSS Adopters (#19820) 
* docs(readme): add OpenAI Agents SDK to OSS Adopters

* docs(readme): add OpenAI Agents SDK logo
 2026-01-26 19:24:46 -08:00