Commit graph

5493 commits

Author SHA1 Message Date
Ishaan Jaff
8c29ad4191 [Fix] VertexAI Pass through - Ensure only anthropic betas are forwarded down to LLM API (#19542)
* fix ALLOWED_VERTEX_AI_PASSTHROUGH_HEADERS

* test_vertex_passthrough_forwards_anthropic_beta_header

* fix test_vertex_passthrough_forwards_anthropic_beta_header

* test_vertex_passthrough_does_not_forward_litellm_auth_token

* fix utils

* Using Anthropic Beta Features on Vertex AI

* test_forward_headers_from_request_x_pass_prefix
2026-01-21 19:12:43 -08:00
Ishaan Jaff
ad1db9fc8b [Fix] LiteLLM VertexAI Pass through - ensuring incoming headers are forwarded down to target (#19524)
* test_vertex_passthrough_forwards_anthropic_beta_header

* add_incoming_headers
2026-01-21 12:06:32 -08:00
Ishaan Jaffer
60dd04ac95 test_aiohttp_openai 2026-01-17 17:05:00 -08:00
Ishaan Jaffer
db7de13818 test_deepseek_mock_completion 2026-01-17 16:36:42 -08:00
Ishaan Jaffer
5812654bdd test_router_fallbacks_with_custom_model_costs 2026-01-17 16:34:46 -08:00
Ishaan Jaff
1417b002a3
[Feat] Claude Code x LiteLLM WebSearch - QA Fixes to work with Claude Code (#19294)
* fix websearch_interception_converted_stream

* test_websearch_interception_no_tool_call_streaming

* FakeAnthropicMessagesStreamIterator

* LITELLM_WEB_SEARCH_TOOL_NAME

* fixes tools def for litellm web search

* fixes FakeAnthropicMessagesStreamIterator

* test_litellm_standard_websearch_tool

* use new hook for modfying before any transfroms from litellm

* init WebSearchInterceptionLogger + ARCHITECTURE

* fix config.yaml

* init doc for claude code web search

* docs fix

* doc fix

* fix mypy linting
2026-01-17 16:30:31 -08:00
Ishaan Jaff
104283ae8f
[Feat] Claude Code - Add Websearch support using LiteLLM /search (using web search interception hook) (#19263)
* init WebSearchInterceptionLogger

* test_websearch_interception_real_call

* init async_should_run_agentic_completion

* async_should_run_agentic_loop

* async_run_agentic_loop

* refactor folder

* fix organization

* WebSearchTransformation

* WebSearchInterceptionLogger

* _call_agentic_completion_hooks

* WebSearch Interception Architecture

* test_websearch_interception_real_call

* add streaming

* add transform_request for streaming

* get_llm_provider

* test fix

* fix info

* init from config.yaml

* fixes

* test handler

* fix _is_streaming_response

* async_run_agentic_loop

* mypy fix
2026-01-16 21:10:05 -08:00
yuneng-jiang
90dc0e9120 Merge remote-tracking branch 'origin' into litellm_deleted_keys_endpoint 2026-01-16 19:25:03 -08:00
yuneng-jiang
de84b2edce Fixing tests and adding proper returns 2026-01-16 19:24:51 -08:00
yuneng-jiang
6e8dd06d18 fixing test 2026-01-16 19:06:23 -08:00
yuneng-jiang
bb4b791746 Merge remote-tracking branch 'origin' into litellm_deleted_keys_endpoint 2026-01-16 18:15:37 -08:00
yuneng-jiang
1911039416 Merge remote-tracking branch 'origin' into litellm_model_hub_health 2026-01-16 18:14:37 -08:00
yuneng-jiang
476258b3f8 Linting 2026-01-16 17:20:01 -08:00
yuneng-jiang
e9c806797d adding tests 2026-01-16 17:11:13 -08:00
yuneng-jiang
96493e3936 Add status to /list in keys and teams 2026-01-16 17:03:09 -08:00
Ishaan Jaff
d2a40c8456
[Fix] - Reliability fix OOMs with image url handling (#19257)
* fix MAX_IMAGE_URL_DOWNLOAD_SIZE_MB

* test_image_exceeds_size_limit_with_content_length

* fix: _process_image_response

* add constants 50MB

* fix convert_to_anthropic_image_obj image handling

* test_gemini_image_size_limit_exceeded

* MAX_IMAGE_URL_DOWNLOAD_SIZE_MB fix

* MAX_IMAGE_URL_DOWNLOAD_SIZE_MB

* test_image_size_limit_disabled

* async_convert_url_to_base64

* docs fix

* code QA check

* fix Exception
2026-01-16 16:41:44 -08:00
Yuta Saito
34e8e97222 fix: ci test
gemini 2.5 depricated
2026-01-17 09:17:31 +09:00
yuneng-jiang
439472f800 /public/model_hub health information 2026-01-16 15:36:56 -08:00
yuneng-jiang
809b4cb310
Revert "Revert "[Feature] Deleted Keys and Deleted Teams Table"" 2026-01-16 14:25:23 -08:00
Yuta Saito
18bcb429fc Manual revert #19078 2026-01-17 06:54:08 +09:00
YutaSaito
034e3a6d44
Revert "[Feature] Deleted Keys and Deleted Teams Table" 2026-01-17 06:46:41 +09:00
YutaSaito
7aba0f738a
Revert "Litellm staging 01 15 2026" 2026-01-17 06:31:34 +09:00
YutaSaito
3e9e65c123
Merge pull request #19245 from BerriAI/revert-19141-litellm_stablise_mock_tests
Revert "Stabilise mock tests"
2026-01-17 06:27:53 +09:00
yuneng-jiang
2394e722d6
Merge branch 'main' into litellm_deleted_keys_team 2026-01-16 13:27:16 -08:00
YutaSaito
eec4ed640b
Revert "Stabilise mock tests" 2026-01-17 06:26:18 +09:00
YutaSaito
edea885316
Merge pull request #19240 from BerriAI/revert-19116-litellm_org_admin_escalte
Revert "[Fix] /user/new Privilege Escalation"
2026-01-17 06:12:14 +09:00
YutaSaito
ca2019776e
Revert "Fix: malformed tool call transformation in bedrock" 2026-01-17 06:04:24 +09:00
YutaSaito
66d67ae356
Revert "Add sanititzation for anthropic messages" 2026-01-17 06:01:12 +09:00
YutaSaito
237ba2203e
Revert "[Fix] /user/new Privilege Escalation" 2026-01-17 05:57:07 +09:00
yuneng-jiang
bd4a893daf fixing tests 2026-01-16 12:42:35 -08:00
Anand Kamble
2c75194b49
fix(vertex_ai): Vertex AI 400 Error: Model used by GenerateContent request (models/gemini-3-*) and CachedContent (models/gemini-3-*) has to be the same (#19193)
* fix(vertex_ai): include model in context cache key generation

* test(vertex_ai): update context caching tests to verify model in cache key
2026-01-17 00:56:15 +05:30
yuneng-jiang
33ff58b70a Merge remote-tracking branch 'origin' into litellm_deleted_keys_team 2026-01-16 09:55:52 -08:00
yuneng-jiang
e3d1e0345c only show own internal user usage 2026-01-16 09:38:34 -08:00
Sameer Kankute
6fecfe4911
Merge pull request #19198 from BerriAI/litellm_handle_malformed_tool_bedrock
Fix: malformed tool call transformation in bedrock
2026-01-16 18:05:10 +05:30
Sameer Kankute
9388dd842a
Merge pull request #19159 from BerriAI/litellm_staging_01_15_2026
Litellm staging 01 15 2026
2026-01-16 18:04:25 +05:30
Sameer Kankute
fb3b4e6b33
Merge pull request #19196 from BerriAI/litellm_sanitise_anthropic_mesages
Add sanititzation for anthropic messages
2026-01-16 17:48:55 +05:30
Sameer Kankute
4ad695e6f0
Merge pull request #19140 from BerriAI/litellm_bedrock_passthroguh_user_logging
Add user auth in standard logging object for bedrock passthrough
2026-01-16 17:47:55 +05:30
Sameer Kankute
43893cb81a
Merge pull request #19191 from BerriAI/litellm_fix_stream_timeout
Fix: [Bug]: stream_timeout:The function of this parameter has been changed
2026-01-16 17:43:43 +05:30
Sameer Kankute
cca6632dae
Merge pull request #19185 from BerriAI/litellm_fallback_endpoints_support
[Feat] Add fallback endpoints support
2026-01-16 17:39:35 +05:30
Sameer Kankute
ca06bb4e3a
Merge pull request #19201 from BerriAI/litellm_fix_vertex_ai_structured_output2
Fix: vertex ai doesn't support structured output
2026-01-16 17:09:03 +05:30
Sameer Kankute
e315f6bed2
Merge pull request #19214 from BerriAI/main
merge main in malformed tool call PR
2026-01-16 17:04:44 +05:30
Sameer Kankute
101230e538
Merge pull request #19213 from BerriAI/main
merge main in sanitisation
2026-01-16 17:04:01 +05:30
Sameer Kankute
f562186c75
Merge pull request #19212 from BerriAI/main
merge main in timeout PR
2026-01-16 17:02:22 +05:30
Sameer Kankute
e54af42774
Merge pull request #19211 from BerriAI/main
merge main in fallback PR
2026-01-16 17:01:10 +05:30
Sameer Kankute
b6aa05df16
Merge pull request #19210 from BerriAI/main
merge main in bedrock passthrough
2026-01-16 17:00:11 +05:30
Sameer Kankute
84974d5745 Fix boto3 conflicting dependency 2026-01-16 16:55:12 +05:30
Sameer Kankute
09fb1581cb Fix:add async_get_available_deployment_for_pass_through in code tests 2026-01-16 16:37:44 +05:30
Sameer Kankute
f3ca05112e
Merge pull request #19206 from BerriAI/main
merge main
2026-01-16 15:22:16 +05:30
Sameer Kankute
dcd66db4a8
Revert "fix: models loadbalancing billing issue by filter (#18891)"
This reverts commit 41d8f79929.
2026-01-16 15:21:10 +05:30
Sameer Kankute
b0c6a1b308
Merge pull request #19203 from BerriAI/main
merge main
2026-01-16 15:16:29 +05:30