Alexsander Hamir
4b6b1da517
fix(otel): fix thread leak in OpenTelemetry dynamic header path
...
Implemented TracerProvider caching in OpenTelemetry class to prevent linear thread growth when using dynamic headers (e.g., per-team Langfuse keys). Added formal unit test in tests/test_otel_thread_leak.py.
2026-01-28 16:15:56 -08:00
Ishaan Jaff
8c29ad4191
[Fix] VertexAI Pass through - Ensure only anthropic betas are forwarded down to LLM API ( #19542 )
...
* fix ALLOWED_VERTEX_AI_PASSTHROUGH_HEADERS
* test_vertex_passthrough_forwards_anthropic_beta_header
* fix test_vertex_passthrough_forwards_anthropic_beta_header
* test_vertex_passthrough_does_not_forward_litellm_auth_token
* fix utils
* Using Anthropic Beta Features on Vertex AI
* test_forward_headers_from_request_x_pass_prefix
2026-01-21 19:12:43 -08:00
Ishaan Jaff
ad1db9fc8b
[Fix] LiteLLM VertexAI Pass through - ensuring incoming headers are forwarded down to target ( #19524 )
...
* test_vertex_passthrough_forwards_anthropic_beta_header
* add_incoming_headers
2026-01-21 12:06:32 -08:00
Ishaan Jaffer
60dd04ac95
test_aiohttp_openai
2026-01-17 17:05:00 -08:00
Ishaan Jaffer
db7de13818
test_deepseek_mock_completion
2026-01-17 16:36:42 -08:00
Ishaan Jaffer
5812654bdd
test_router_fallbacks_with_custom_model_costs
2026-01-17 16:34:46 -08:00
Ishaan Jaff
1417b002a3
[Feat] Claude Code x LiteLLM WebSearch - QA Fixes to work with Claude Code ( #19294 )
...
* fix websearch_interception_converted_stream
* test_websearch_interception_no_tool_call_streaming
* FakeAnthropicMessagesStreamIterator
* LITELLM_WEB_SEARCH_TOOL_NAME
* fixes tools def for litellm web search
* fixes FakeAnthropicMessagesStreamIterator
* test_litellm_standard_websearch_tool
* use new hook for modfying before any transfroms from litellm
* init WebSearchInterceptionLogger + ARCHITECTURE
* fix config.yaml
* init doc for claude code web search
* docs fix
* doc fix
* fix mypy linting
2026-01-17 16:30:31 -08:00
Ishaan Jaff
104283ae8f
[Feat] Claude Code - Add Websearch support using LiteLLM /search (using web search interception hook) ( #19263 )
...
* init WebSearchInterceptionLogger
* test_websearch_interception_real_call
* init async_should_run_agentic_completion
* async_should_run_agentic_loop
* async_run_agentic_loop
* refactor folder
* fix organization
* WebSearchTransformation
* WebSearchInterceptionLogger
* _call_agentic_completion_hooks
* WebSearch Interception Architecture
* test_websearch_interception_real_call
* add streaming
* add transform_request for streaming
* get_llm_provider
* test fix
* fix info
* init from config.yaml
* fixes
* test handler
* fix _is_streaming_response
* async_run_agentic_loop
* mypy fix
2026-01-16 21:10:05 -08:00
yuneng-jiang
90dc0e9120
Merge remote-tracking branch 'origin' into litellm_deleted_keys_endpoint
2026-01-16 19:25:03 -08:00
yuneng-jiang
de84b2edce
Fixing tests and adding proper returns
2026-01-16 19:24:51 -08:00
yuneng-jiang
6e8dd06d18
fixing test
2026-01-16 19:06:23 -08:00
yuneng-jiang
bb4b791746
Merge remote-tracking branch 'origin' into litellm_deleted_keys_endpoint
2026-01-16 18:15:37 -08:00
yuneng-jiang
1911039416
Merge remote-tracking branch 'origin' into litellm_model_hub_health
2026-01-16 18:14:37 -08:00
yuneng-jiang
476258b3f8
Linting
2026-01-16 17:20:01 -08:00
yuneng-jiang
e9c806797d
adding tests
2026-01-16 17:11:13 -08:00
yuneng-jiang
96493e3936
Add status to /list in keys and teams
2026-01-16 17:03:09 -08:00
Ishaan Jaff
d2a40c8456
[Fix] - Reliability fix OOMs with image url handling ( #19257 )
...
* fix MAX_IMAGE_URL_DOWNLOAD_SIZE_MB
* test_image_exceeds_size_limit_with_content_length
* fix: _process_image_response
* add constants 50MB
* fix convert_to_anthropic_image_obj image handling
* test_gemini_image_size_limit_exceeded
* MAX_IMAGE_URL_DOWNLOAD_SIZE_MB fix
* MAX_IMAGE_URL_DOWNLOAD_SIZE_MB
* test_image_size_limit_disabled
* async_convert_url_to_base64
* docs fix
* code QA check
* fix Exception
2026-01-16 16:41:44 -08:00
Yuta Saito
34e8e97222
fix: ci test
...
gemini 2.5 depricated
2026-01-17 09:17:31 +09:00
yuneng-jiang
439472f800
/public/model_hub health information
2026-01-16 15:36:56 -08:00
yuneng-jiang
809b4cb310
Revert "Revert "[Feature] Deleted Keys and Deleted Teams Table""
2026-01-16 14:25:23 -08:00
Yuta Saito
18bcb429fc
Manual revert #19078
2026-01-17 06:54:08 +09:00
YutaSaito
034e3a6d44
Revert "[Feature] Deleted Keys and Deleted Teams Table"
2026-01-17 06:46:41 +09:00
YutaSaito
7aba0f738a
Revert "Litellm staging 01 15 2026"
2026-01-17 06:31:34 +09:00
YutaSaito
3e9e65c123
Merge pull request #19245 from BerriAI/revert-19141-litellm_stablise_mock_tests
...
Revert "Stabilise mock tests"
2026-01-17 06:27:53 +09:00
yuneng-jiang
2394e722d6
Merge branch 'main' into litellm_deleted_keys_team
2026-01-16 13:27:16 -08:00
YutaSaito
eec4ed640b
Revert "Stabilise mock tests"
2026-01-17 06:26:18 +09:00
YutaSaito
edea885316
Merge pull request #19240 from BerriAI/revert-19116-litellm_org_admin_escalte
...
Revert "[Fix] /user/new Privilege Escalation"
2026-01-17 06:12:14 +09:00
YutaSaito
ca2019776e
Revert "Fix: malformed tool call transformation in bedrock"
2026-01-17 06:04:24 +09:00
YutaSaito
66d67ae356
Revert "Add sanititzation for anthropic messages"
2026-01-17 06:01:12 +09:00
YutaSaito
237ba2203e
Revert "[Fix] /user/new Privilege Escalation"
2026-01-17 05:57:07 +09:00
yuneng-jiang
bd4a893daf
fixing tests
2026-01-16 12:42:35 -08:00
Anand Kamble
2c75194b49
fix(vertex_ai): Vertex AI 400 Error: Model used by GenerateContent request (models/gemini-3-*) and CachedContent (models/gemini-3-*) has to be the same ( #19193 )
...
* fix(vertex_ai): include model in context cache key generation
* test(vertex_ai): update context caching tests to verify model in cache key
2026-01-17 00:56:15 +05:30
yuneng-jiang
33ff58b70a
Merge remote-tracking branch 'origin' into litellm_deleted_keys_team
2026-01-16 09:55:52 -08:00
yuneng-jiang
e3d1e0345c
only show own internal user usage
2026-01-16 09:38:34 -08:00
Sameer Kankute
6fecfe4911
Merge pull request #19198 from BerriAI/litellm_handle_malformed_tool_bedrock
...
Fix: malformed tool call transformation in bedrock
2026-01-16 18:05:10 +05:30
Sameer Kankute
9388dd842a
Merge pull request #19159 from BerriAI/litellm_staging_01_15_2026
...
Litellm staging 01 15 2026
2026-01-16 18:04:25 +05:30
Sameer Kankute
fb3b4e6b33
Merge pull request #19196 from BerriAI/litellm_sanitise_anthropic_mesages
...
Add sanititzation for anthropic messages
2026-01-16 17:48:55 +05:30
Sameer Kankute
4ad695e6f0
Merge pull request #19140 from BerriAI/litellm_bedrock_passthroguh_user_logging
...
Add user auth in standard logging object for bedrock passthrough
2026-01-16 17:47:55 +05:30
Sameer Kankute
43893cb81a
Merge pull request #19191 from BerriAI/litellm_fix_stream_timeout
...
Fix: [Bug]: stream_timeout：The function of this parameter has been changed
2026-01-16 17:43:43 +05:30
Sameer Kankute
cca6632dae
Merge pull request #19185 from BerriAI/litellm_fallback_endpoints_support
...
[Feat] Add fallback endpoints support
2026-01-16 17:39:35 +05:30
Sameer Kankute
ca06bb4e3a
Merge pull request #19201 from BerriAI/litellm_fix_vertex_ai_structured_output2
...
Fix: vertex ai doesn't support structured output
2026-01-16 17:09:03 +05:30
Sameer Kankute
e315f6bed2
Merge pull request #19214 from BerriAI/main
...
merge main in malformed tool call PR
2026-01-16 17:04:44 +05:30
Sameer Kankute
101230e538
Merge pull request #19213 from BerriAI/main
...
merge main in sanitisation
2026-01-16 17:04:01 +05:30
Sameer Kankute
f562186c75
Merge pull request #19212 from BerriAI/main
...
merge main in timeout PR
2026-01-16 17:02:22 +05:30
Sameer Kankute
e54af42774
Merge pull request #19211 from BerriAI/main
...
merge main in fallback PR
2026-01-16 17:01:10 +05:30
Sameer Kankute
b6aa05df16
Merge pull request #19210 from BerriAI/main
...
merge main in bedrock passthrough
2026-01-16 17:00:11 +05:30
Sameer Kankute
84974d5745
Fix boto3 conflicting dependency
2026-01-16 16:55:12 +05:30
Sameer Kankute
09fb1581cb
Fix:add async_get_available_deployment_for_pass_through in code tests
2026-01-16 16:37:44 +05:30
Sameer Kankute
f3ca05112e
Merge pull request #19206 from BerriAI/main
...
merge main
2026-01-16 15:22:16 +05:30
Sameer Kankute
dcd66db4a8
Revert "fix: models loadbalancing billing issue by filter ( #18891 )"
...
This reverts commit 41d8f79929
2026-01-16 15:21:10 +05:30
