Commit graph

14665 commits

Author SHA1 Message Date
Ishaan Jaff
539f629eff
[Feat] New Logging Integration - Azure Sentinel Logger (#18146)
* add AzureSentinelLogger

* logging: AzureSentinelLogger

* test_azure_sentinel_signature_and_send_batch

* docs azure sentinel

* fix AzureSentinelLogger

* test fix

* docs fix

* fix: AzureSentinelLogger

* docs sentintel

* feat: add example SLP

* docs sentinel

* docs fix

* docs fix

* docs fix

* fix code qa

* QA fix

* fix test

* TestInitializeInteractionsEndpoints
2025-12-18 02:04:49 +05:30
yuneng-jiang
087dfbf648 Merge remote-tracking branch 'origin' into litellm_email_budget_alerts_2 2025-12-17 11:37:49 -08:00
yuneng-jiang
8cdb481832 Merge remote-tracking branch 'origin' into litellm_new_user_collision_handling 2025-12-17 11:34:46 -08:00
yuneng-jiang
49a1e50672
Merge pull request #17912 from BerriAI/litellm_dd_callback_fix
[Fix] Callback Environment Variables Casing
2025-12-17 11:33:41 -08:00
yuneng-jiang
202f71c13a
Merge pull request #17752 from BerriAI/litellm_ui_model_test_connection_fix
[Fix] /health/test_connection to resolve env variables like /chat/completions
2025-12-17 11:06:57 -08:00
yuneng-jiang
70f7c8b771 Merge remote-tracking branch 'origin' into litellm_dd_callback_fix 2025-12-17 11:05:46 -08:00
yuneng-jiang
358ee482e2
Merge pull request #18078 from BerriAI/litellm_sso_readiness_route
[Feature] SSO Readiness Health Check
2025-12-17 11:03:53 -08:00
Sameer Kankute
f5de678f4d
Merge branch 'main' into litellm_fix_custom_gaurdrail_fix 2025-12-17 23:00:46 +05:30
Sameer Kankute
cb6878cdac
Merge pull request #18115 from BerriAI/litellm_bedrock_image_gaurdrail_support1
Add support for bedrock image gaurdrails
2025-12-17 22:58:24 +05:30
Sameer Kankute
a13611dcdb
Merge branch 'main' into litellm_image_edit_vertex_cred_fix 2025-12-17 22:38:07 +05:30
Sameer Kankute
230db7e161
Merge pull request #18100 from BerriAI/litellm_bedrock_qwen_arn_fix
fix: Add qwen 2 and qwen 3 in get_bedrock_model_id
2025-12-17 22:34:05 +05:30
Sameer Kankute
25f2213262
Merge pull request #18135 from BerriAI/litellm_gemini_flash_day_0
feat: gemini-3-flash-preview day 0 support
2025-12-17 22:30:10 +05:30
Sameer Kankute
95b2e72dfc
Merge pull request #18105 from BerriAI/litellm_staging_12_17_2025
Staging - 12/17/2025
2025-12-17 22:23:21 +05:30
Sameer Kankute
e3cf0110bb Rename: gemini-3-flash-preview 2025-12-17 21:48:15 +05:30
Alexsander Hamir
e96b301642
Fix: Prevent LiteLLM API key leakage on /health endpoint failures (#18133) 2025-12-17 08:08:05 -08:00
Sameer Kankute
22e86cde2a Add support for gemini 3 flash via v1/messages endpoint 2025-12-17 18:03:54 +05:30
Sameer Kankute
ba90985300 Add reasoning effort mapping 2025-12-17 18:03:48 +05:30
Sameer Kankute
ed6c66c20c Add support for structured output thinkingConfig param 2025-12-17 18:02:15 +05:30
Sameer Kankute
969ed1efb8 fix: Vertex AI image edit credential source 2025-12-17 15:56:10 +05:30
Alexandros Solanos
ed5dc6a077
Improve model repetition detection performance 2025-12-17 10:02:41 +01:00
Sameer Kankute
085b07cdde Add test for handling gaurdrails param 2025-12-17 14:12:27 +05:30
Sameer Kankute
b7550ea2d4 Add test for gaurdrail in passthrough 2025-12-17 12:52:21 +05:30
Curtis
d1c6eb3a7c
fix(image_edit): add drop_params support and fix Vertex AI config (#18077) 2025-12-17 11:28:34 +05:30
yuneng-jiang
9faee8bba6
Merge pull request #17989 from Jetemple/non-root-ui-path-fix
fix: update UI path handling for non-root Docker and restructure HTML…
2025-12-16 21:57:31 -08:00
jk-f5
576580244f
fix(azure_ai): return AzureAnthropicConfig for Claude models in get_provider_chat_config (#18086)
Claude models on Azure AI were incorrectly using AzureAIStudioConfig,
causing tool calls to fail with invalid_request_error because tools
remained in OpenAI format instead of being transformed to Anthropic format.
2025-12-17 11:24:04 +05:30
Shivam Rawat
14a4a9c031
added extraction of top level metadata for custom lables in prometheus callbacks (#18087) 2025-12-17 11:17:12 +05:30
Kris Xia
be2f429087
fix(proxy): extract model from vertex ai passthrough url pattern (#18097)
extract model id from vertex ai passthrough routes that follow the pattern:
/vertex_ai/*/models/{model_id}:*

the model extraction now handles vertex ai routes by regex matching the model
segment from the url path, which allows proper model identification for
authentication and authorization in proxy pass-through endpoints.

adds comprehensive test coverage for vertex ai model extraction including:
- various vertex api versions (v1, v1beta1)
- different locations (us-central1, asia-southeast1)
- model names with special suffixes (gemini-1.5-pro, gemini-2.0-flash)
- precedence verification (request body model over url)
- non-vertex route isolation
2025-12-17 11:10:14 +05:30
Sameer Kankute
f83b821f3d fix: Add qwen 2 and qwen 3 in get_bedrock_model_id 2025-12-17 09:22:55 +05:30
yuneng-jiang
42d7d757a3 Adding role mappings to SSOConfig DB 2025-12-16 15:48:26 -08:00
yuneng-jiang
f316caa088
Merge pull request #18033 from BerriAI/litellm_ui_logs_overhead
[Feature] Add LiteLLM Overhead to Logs
2025-12-16 14:51:50 -08:00
Jorge Yero Salazar
48a3a741e5
Allow base_model for non Azure providers in proxy (#18038)
* Allow base_model for non Azure providers in proxy

* Add tests
2025-12-17 02:24:12 +04:00
Ishaan Jaff
c727c8216f
[Feat] New Endpoint - Google Interactions API - added on litellm SDK (#18079)
* init BaseInteractionsAPIConfig

* updated types for interactions API

* fix SDK level interactions API

* InteractionsAPIRequestUtils

* init base

* init interactions API

* init Interactions API Types

* init interactins API

* GoogleAIStudioInteractionsConfig

* init http handler

* remove file no longer needed

* test OPENAPI_SPEC_URL

* TestGoogleInteractionsCreate
2025-12-17 02:18:51 +04:00
yuneng-jiang
c2f79681b6 Fixing test 2 2025-12-16 13:44:53 -08:00
yuneng-jiang
2d8f5111af add /sso/readiness route 2025-12-16 13:16:13 -08:00
yuneng-jiang
0e5b56eddf Fixing tests 2025-12-16 12:51:44 -08:00
Alexsander Hamir
80d445a96f
feat: lazy load GuardrailItem following existing patterns (#18072)
- Add TYPES_NAMES tuple and _lazy_import_types function in _lazy_imports.py
- Remove direct import of GuardrailItem from __init__.py
- Add lazy loading handler in __getattr__ to dispatch type imports
- Add type stub for GuardrailItem in TYPE_CHECKING block
- Add test_types_lazy_imports test to verify lazy loading works
- Use from __future__ import annotations for forward reference support
- Follows same pattern as DOTPROMPT_NAMES and LLM_CONFIG_NAMES for consistency
2025-12-16 11:48:36 -08:00
Alexsander Hamir
014c74fd06
[Refactor] litellm/init.py: lazy-load AmazonConverseConfig (#18069)
- Add LLM_CONFIG_NAMES tuple and _lazy_import_llm_configs function in _lazy_imports.py
- Remove direct import of AmazonConverseConfig from __init__.py
- Add lazy loading handler in __getattr__ to dispatch LLM config imports
- Add type stub for AmazonConverseConfig in TYPE_CHECKING block
- Add test_llm_config_lazy_imports test to verify lazy loading works
- Follows same pattern as DOTPROMPT_NAMES for consistency
2025-12-16 10:48:11 -08:00
Sameer Kankute
2b495f84ab
Merge pull request #18025 from BerriAI/litellm_staging_12_16_2025
Litellm staging 12 16 2025
2025-12-16 22:31:39 +05:30
Sameer Kankute
3661f8010f
Revert "fix(proxy): extract model from vertex ai passthrough url pattern (#17…"
This reverts commit ae7c994526.
2025-12-16 21:44:10 +05:30
Sameer Kankute
20bdada900
Merge pull request #18046 from BerriAI/litellm_fix_managed_files_endpoint
Fix managed files endpoint
2025-12-16 21:39:34 +05:30
Sameer Kankute
8864c6937c
Merge pull request #18031 from BerriAI/litellm_anthropic_claude_skills_int
Add support for agent skills in chat completion
2025-12-16 21:39:11 +05:30
Sameer Kankute
215857cce3
Merge branch 'main' into litellm_staging_12_16_2025 2025-12-16 21:38:14 +05:30
Chesars
7b6a00d3df fix: remove deprecated Groq models and update model registry
- Remove 20 deprecated/unavailable Groq models from registry
- Add groq/meta-llama/llama-guard-4-12b (new safety model)
- Add supports_vision to Llama 4 models (maverick, scout)
- Update Groq documentation with current model list
- Clean up test file references to deprecated models

Fixes #18043
2025-12-16 13:06:33 -03:00
Sameer Kankute
fc5c5d4dbe
Merge pull request #18042 from BerriAI/litellm_embedding_default_omit
fix: Add none to encoding_format instead of omitting it
2025-12-16 21:35:29 +05:30
Sameer Kankute
abfa869030
Merge pull request #18049 from BerriAI/litellm_bedrock_ttl_issue
Remove ttl field when routing to bedrock
2025-12-16 21:34:57 +05:30
Sameer Kankute
616417eaaa
Merge pull request #18037 from BerriAI/litellm_fix_vertex_ai_headers
fix: skip adding beta headers for vertex ai as it is not suppported
2025-12-16 21:33:35 +05:30
Sameer Kankute
de5471e3cd
Merge pull request #18036 from BerriAI/litellm_fix_responses_headers
Add custom headers in responses API
2025-12-16 21:30:59 +05:30
Alexsander Hamir
f8168f5063
[Refactor] litellm/init.py: lazy load dotprompt integration (#18056) 2025-12-16 07:18:11 -08:00
Alexsander Hamir
feb6924efe
[Refactor] litellm/init.py: lazy load .types.utils (#18054) 2025-12-16 06:42:17 -08:00
Alexsander Hamir
ea06fb70fb
refactor: lazy load bedrock types (#18053) 2025-12-16 06:05:01 -08:00