scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-10 03:28:53 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 84
32007 commits 3393 branches 1449 tags 5.1 GiB
Commit graph

32007 commits

This branch
This branch
All branches
Author SHA1 Message Date
Brian Caswell
920ef665a3
inspect BadRequestError after all other policy types (#19878) 
As indicated by https://docs.litellm.ai/docs/exception_mapping,
BadRequestError is used as the base type for multiple exceptions.  As
such, it should be tested last in handling retry policies.

This updates the integration test that validates retry policies work as
expected.

Fixes #19876
 2026-01-27 18:15:04 -08:00
yuneng-jiang
29c841d7f9 Fixing build and tests 2026-01-27 18:14:30 -08:00
Ryan Wilson
70eb732b41
docs: fix guardrail logging docs (#19833) 2026-01-27 18:13:04 -08:00
Pragya Sardana
b4a27712a1
Add Init Containers in the community helm chart (#19816) 2026-01-27 18:10:47 -08:00
yuneng-jiang
37bfab929d All Models Page server side sorting 2026-01-27 18:08:17 -08:00
Teo Stocco
d6cf4df3cb
fix: tool with antropic #19800 (#19805) 2026-01-27 18:02:37 -08:00
Jay Prajapati
6a9d41234f
fix: allow tool_choice for Azure GPT-5 chat models (#19813) 
* fix: don't treat gpt-5-chat as GPT-5 reasoning

* fix: mark azure gpt-5-chat as supporting tool_choice

* test: cover gpt-5-chat params on azure/openai
 2026-01-27 17:51:13 -08:00
Jay Prajapati
4717f742eb
fix: filter unsupported beta headers for Bedrock Invoke API (#19877) 
- Add whitelist-based filtering for anthropic_beta headers
- Only allow Bedrock-supported beta flags (computer-use, tool-search, etc.)
- Filter out unsupported flags like mcp-servers, structured-outputs
- Remove output_format parameter from Bedrock Invoke requests
- Force tool-based structured outputs when response_format is used

Fixes #16726
 2026-01-27 17:47:27 -08:00
Harshit Jain
54a83e75cc
fix: add fix for migration issue and and stable linux debain (#19843) 2026-01-27 17:38:02 -08:00
Harshit Jain
d0939075bc
fix: guardrails issues streaming-response regex (#19901) 2026-01-27 17:36:18 -08:00
michelligabriele
8c4ccdc313
test(proxy): add regression tests for vertex passthrough model names with slashes (#19855) 
Added test cases for custom model names containing slashes in Vertex AI
passthrough URLs (e.g., gcp/google/gemini-2.5-flash).

Test cases:
- gcp/google/gemini-2.5-flash
- gcp/google/gemini-3-flash-preview
- custom/model
 2026-01-27 17:34:40 -08:00
yuneng-jiang
936a4fc884
Merge pull request #19905 from BerriAI/litellm_ci_ui_fix 
[Infra] CI/CD - Fixing UI Tests
 2026-01-27 17:21:39 -08:00
yuneng-jiang
01e22fd5ab Fixing UI tests 2026-01-27 17:19:02 -08:00
yuneng-jiang
7109aafe4c
Merge pull request #19903 from BerriAI/litellm_ui_model_table_adjustable_col 
[Feature] Add sortBy and sortOrder params for /v2/model/info
 2026-01-27 17:16:22 -08:00
yuneng-jiang
a7ead71499 ruff check 2026-01-27 17:00:14 -08:00
yuneng-jiang
1581bcf985 add sortBy and sortOrder params for /v2/model/info 2026-01-27 16:54:52 -08:00
Xianzong Xie
f9eea06a37 Add tests for native_background_mode feature 
Added 8 new unit tests for the native_background_mode feature:
- test_polling_disabled_when_model_in_native_background_mode
- test_polling_disabled_for_native_background_mode_with_provider_list
- test_polling_enabled_when_model_not_in_native_background_mode
- test_polling_enabled_when_native_background_mode_is_none
- test_polling_enabled_when_native_background_mode_is_empty_list
- test_native_background_mode_exact_match_required
- test_native_background_mode_with_provider_prefix_in_request
- test_native_background_mode_with_router_lookup

Committed-By-Agent: cursor
 2026-01-27 16:48:22 -08:00
Ishaan Jaff
51339f5ef1
[Feat] RAG API - Add s3_vectors as provider on /vector_store/search API + UI for creating + PDF support for /rag/ingest (#19895) 
* init S3VectorsRAGIngestion as a supported ingestion provider for RAG API

* test: TestRAGS3Vectors

* init S3VectorsVectorStoreOptions

* init s3 vectors

* code clean up + QA

* fix: get_credentials

* S3VectorsRAGIngestion

* TestRAGS3Vectors

* docs: AWS S3 Vectors

* add asyncio QA checks

* fix: S3_VECTORS_DEFAULT_DIMENSION

* init ui for bedrock s3 vectors

* fix add /search support for s3_vectors

* init atransform_search_vector_store_request

* feat: S3VectorsVectorStoreConfig

* TestS3VectorsVectorStoreConfig

* atransform_search_vector_store_request

* fix: S3VectorsVectorStoreConfig

* add validation for bucket name etd

* fix UI validation for s3 vector store

* init extract_text_from_pdf

* add pypdf

* fix code QA checks

* fix navbar

* init s3_vector.png

* fix QA code
 2026-01-27 16:30:59 -08:00
Xianzong Xie
0b8c10c488 Add native_background_mode to override polling_via_cache for specific models 
This follow-up to PR #16862 allows users to specify models that should use
the native provider's background mode instead of polling via cache.

Config example:
  litellm_settings:
    responses:
      background_mode:
        polling_via_cache: ["openai"]
        native_background_mode: ["o4-mini-deep-research"]
        ttl: 3600

When a model is in native_background_mode list, should_use_polling_for_request
returns False, allowing the request to fall through to native provider handling.

Committed-By-Agent: cursor
 2026-01-27 15:54:46 -08:00
Ishaan Jaff
fe444f3ed5
[Feat] RAG API - Add support for using s3 Vectors as Vector Store Provider for /rag/ingest (#19888) 
* init S3VectorsRAGIngestion as a supported ingestion provider for RAG API

* test: TestRAGS3Vectors

* init S3VectorsVectorStoreOptions

* init s3 vectors

* code clean up + QA

* fix: get_credentials

* S3VectorsRAGIngestion

* TestRAGS3Vectors

* docs: AWS S3 Vectors

* add asyncio QA checks

* fix: S3_VECTORS_DEFAULT_DIMENSION
 2026-01-27 14:45:26 -08:00
yuneng-jiang
93d6aae4a3 mypy linting 2026-01-27 14:06:54 -08:00
yuneng-jiang
1411a227aa bulk update keys endpoint 2026-01-27 13:58:32 -08:00
jayy-77
980ec2afe8 test: cover LITELLM_USER_AGENT override in custom_httpx handlers 2026-01-28 02:09:47 +05:30
jayy-77
b87076875b refactor: drop disable_default_user_agent setting 2026-01-28 02:09:40 +05:30
jayy-77
bf0670edfd fix: honor LITELLM_USER_AGENT for default User-Agent 2026-01-28 02:09:30 +05:30
michelligabriele
7d5439adda
fix(bedrock): support tool search header translation for Sonnet 4.5 (#19871) 
Extend advanced-tool-use header translation to include Claude Sonnet 4.5
in addition to Opus 4.5 on Bedrock Invoke API.

When Claude Code sends the advanced-tool-use-2025-11-20 header, it now
gets correctly translated to Bedrock-specific headers for both:
- Claude Opus 4.5
- Claude Sonnet 4.5

Headers translated:
- tool-search-tool-2025-10-19
- tool-examples-2025-10-29

Fixes defer_loading validation error on Bedrock with Sonnet 4.5.

Ref: https://platform.claude.com/docs/en/agents-and-tools/tool-use/tool-search-tool
 2026-01-27 12:17:09 -08:00
Milan
3f99a91a47 initialize tiktoken environment at import time to support offline usage 2026-01-27 22:05:04 +02:00
jayy-77
b20cf7dfa9 test: add comprehensive tests for User-Agent customization 
Add 8 tests covering:
- Default User-Agent behavior
- Disabling default User-Agent
- Custom User-Agent via extra_headers
- Environment variable support
- Async handler support
- Override without disabling
- Claude Code use case
- Backwards compatibility
 2026-01-28 00:50:04 +05:30
jayy-77
a14703eb17 refactor: update HTTP handlers to respect disable_default_user_agent 
Modify http_handler.py and httpx_handler.py to check the
disable_default_user_agent flag and return empty headers when disabled.
This allows users to override the User-Agent header completely.
 2026-01-28 00:50:02 +05:30
jayy-77
fe184936ff feat: add disable_default_user_agent flag 
Add litellm.disable_default_user_agent global flag to control whether
the automatic User-Agent header is injected into HTTP requests.
 2026-01-28 00:49:52 +05:30
yuneng-jiang
45954155d7
Merge pull request #19799 from BerriAI/litellm_sso_email_casing 
[Fix] SSO Email Case Sensitivity
 2026-01-27 09:52:03 -08:00
yuneng-jiang
50612715a5
Merge pull request #19814 from BerriAI/litellm_team_member_add_fix 
[Fix] /team/member_add User Email and ID Verifications
 2026-01-27 09:49:01 -08:00
michelligabriele
388b4c90b6
fix(proxy): handle agent parameter in /interactions endpoint (#19866) 2026-01-27 09:34:58 -08:00
michelligabriele
fc7a9b4cb0
fix(enterprise): correct error message for DISABLE_ADMIN_ENDPOINTS (#19861) 
The error message for DISABLE_ADMIN_ENDPOINTS incorrectly said
"DISABLING LLM API ENDPOINTS is an Enterprise feature" instead of
"DISABLING ADMIN ENDPOINTS is an Enterprise feature".

This was a copy-paste bug from the is_llm_api_route_disabled() function.

Added regression tests to verify both error messages are correct.
 2026-01-27 09:34:30 -08:00
Harshit Jain
0f0b71e6d9
feat: add feature to make silent calls (#19544) 
* feat: add feature to make silent calls

* add test or silent feat

* add docs for silent feat

* fix lint issues and  UI logs

* add docs of ab testing and deep copy
 2026-01-27 09:16:53 -08:00
Sameer Kankute
5c1588e3b7
Merge pull request #19841 from BerriAI/litellm_bedrock_tool_search_header 
Translate advanced-tool-use to Bedrock-specific headers for Claude Opus 4.5
 2026-01-27 17:48:51 +05:30
Sameer Kankute
81020d05d2
Merge pull request #19844 from BerriAI/litellm_sarvam_doc 
[Docs]Add sarvam usage documentation
 2026-01-27 17:47:59 +05:30
Sameer Kankute
c8a93c7d81
Merge pull request #19845 from BerriAI/litellm_gemini-robotics-er-1.5-preview2 
Add  Gemini Robotics-ER 1.5 preview support
 2026-01-27 17:47:44 +05:30
Sameer Kankute
8565a9f5a2
Merge pull request #19847 from BerriAI/litellm_image_streaming_download 
Fix: Stream the download in chunks for image handling
 2026-01-27 17:47:35 +05:30
Sameer Kankute
29fc4f8f61
Merge pull request #19850 from BerriAI/litellm_grok_reasonnig_support 
Add grok reasoning content
 2026-01-27 17:46:07 +05:30
Sameer Kankute
c834d7d1fe
Merge branch 'main' into litellm_oss_staging_01_27_2026 2026-01-27 17:11:15 +05:30
Sameer Kankute
ea0a264a3c
Merge pull request #19753 from BerriAI/litellm_oss_staging_01_26_2026 
fix(proxy): support slashes in google generateContent model names (#1…
 2026-01-27 17:09:12 +05:30
Sameer Kankute
0214cb04cd
Merge branch 'main' into litellm_oss_staging_01_26_2026 2026-01-27 17:00:58 +05:30
Sameer Kankute
adf6d7e1db
Merge pull request #19692 from BerriAI/litellm_oss_staging_01_24_2026 
Litellm oss staging 01 24 2026
 2026-01-27 16:59:28 +05:30
Sameer Kankute
9a2750f8ec
Merge pull request #19617 from BerriAI/litellm_oss_staging_01_23_2026 
Litellm oss staging 01 23 2026
 2026-01-27 16:55:32 +05:30
Sameer Kankute
f30742fe6e Fix mypy and code quality issues 2026-01-27 16:49:39 +05:30
Sameer Kankute
154ad179af Revert poetry lock 2026-01-27 16:39:56 +05:30
Sameer Kankute
e695cb5367 Add grok reasoning content 2026-01-27 16:34:57 +05:30
Sameer Kankute
bd95712a22
Merge pull request #19832 from BerriAI/litellm_fix_a2a_package 
Fix: A2A Python SDK URL
 2026-01-27 15:16:52 +05:30
Sameer Kankute
988dd2a911 Fix: Stream the download in chunks 2026-01-27 14:35:54 +05:30