Commit graph

14665 commits

Author SHA1 Message Date
Ishaan Jaff
1cdfb3da8f
[Bug Fix] - Fix litellm_enterprise ensure imported routes exist (#17337)
* test_enterprise_routes.py

* test_enterprise_routes_all_imports_exist
2025-12-01 19:14:12 -08:00
Sameer Kankute
289c13ca5d
Merge pull request #17260 from abi-jey/main
fix: GA path for azure openai realtime models
2025-12-02 08:34:10 +05:30
Sameer Kankute
dbf1cd591d
Merge pull request #17271 from colinlin-stripe/cherry-pick-invoke-headers
[fix] extra_headers in messages api bedrock invoke
2025-12-02 08:26:54 +05:30
Ishaan Jaff
860cdc81d3
[Fix] Fix Watsonx Audio Transcription API (#17326)
* """
add

* fix transform_audio_transcription_request

* fix tests

* test_watsonx_transcription_request_body
2025-12-01 18:26:56 -08:00
Elias
37ecb03d4f
Add support of audio transcription for OVHcloud (#17305) 2025-12-01 18:26:39 -08:00
Krish Dholakia
1eb06f8031
Revert "fix: respect guardrail mock_response during during_call to return blo…" (#17332)
This reverts commit 6de6107673.
2025-12-01 15:40:28 -08:00
Ishaan Jaff
24f847b84c
[Feat] JWT Auth - AI Gateway, allow using regular OIDC flow with user info endpoints (#17324)
* feat: allow fetching OIDC user info

* test: use test_auth_builder_with_oidc_userinfo_enabled gets user info when enabled

* fix tool permission doc

* docs fix diagram
2025-12-01 13:59:00 -08:00
Ishaan Jaff
ce0dc0c8b9
[Feat] WatsonX - allow passing zen_api_key dynamically (#16655)
* test_watsonx_zen_api_key_from_client

* zen api key

* docs using zen api key
2025-12-01 12:55:47 -08:00
Colin Lin
661bccbc39 fixed flaky test by sorting list 2025-12-01 14:26:14 -05:00
Colin Lin
e420b633a1 add tests 2025-12-01 14:25:37 -05:00
orgersh92
7808a610f8
Fix session consistency, move Lasso API version away from source code (#17316)
* store and fetch lasso-conversation id from cache

* include gateway/v# in the baseUrl to allow simpler version migrations in the future

* add tests for cached conversation ID
2025-12-01 10:03:51 -08:00
YutaSaito
6de6107673
fix: respect guardrail mock_response during during_call to return blocked output (#17247) 2025-12-01 09:59:01 -08:00
Sameer Kankute
353c779c34
Merge pull request #17301 from BerriAI/litellm_claude_code_beta_fix
Remove not compatible beta header from Bedrock
2025-12-01 21:39:37 +05:30
Chesars
8f6822a642 Fix: Allow reasoning_effort='none' for Azure gpt-5.1 models
PR #17071 drops or errors on reasoning_effort='none' for all GPT models.
It doesn't actually allow 'none' to be sent to Azure for gpt-5.1 which
supports it according to Azure documentation.

See: https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/reasoning
"none is only supported for gpt-5.1"
2025-12-01 12:55:01 -03:00
Sameer Kankute
983ba7aa0f Remove not compatible beta header from claude code 2025-12-01 17:22:04 +05:30
Sameer Kankute
7dac498efb Add passthrough cost tracking for veo 2025-12-01 14:33:03 +05:30
Sameer Kankute
9edc50efbd Fix 500 error for malformed request 2025-12-01 10:21:44 +05:30
Sameer Kankute
7f42b9b987
Merge pull request #17193 from BerriAI/litellm_twelvelabs_int
Added support for twelvelabs pegasus
2025-11-28 22:09:00 +05:30
hxomer
b85df0b1fb
Better handle anonymization (#17207)
* Better handle anonymization

* Fix tests
2025-11-28 08:22:19 -08:00
Sameer Kankute
9d058398df Fix pegasus response and add doc 2025-11-28 21:41:25 +05:30
Sameer Kankute
bcc35a6069
Merge pull request #17253 from BerriAI/litellm_nova_embedding_support
Add nova embedding support
2025-11-28 21:16:06 +05:30
Sameer Kankute
bb11c4fb3f
Merge pull request #17258 from BerriAI/litellm_add_tags_in_ui
Fix metadata tags and model name display in UI for Azure passthrough + Add cost tracking for responses API
2025-11-28 21:15:39 +05:30
Sameer Kankute
6c326ceb87
Merge pull request #17142 from BerriAI/litellm_anthropic_update_new_feat
Update new anthropic feats as reviewed
2025-11-28 21:06:34 +05:30
abbas jafari
23b737d2a4
Merge branch 'BerriAI:main' into main 2025-11-28 15:28:52 +01:00
abi_jey
4cf7a74e60 fix: Azure OpenAI GA path relies soley on model paramter as deployment 2025-11-28 14:27:57 +00:00
Sameer Kankute
f0d3c96a8d Add tags and other field in UI logs and add responses api cost tracking 2025-11-28 17:23:15 +05:30
Sameer Kankute
8700c5ced6 Add nova embedding support 2025-11-28 14:56:46 +05:30
v0rtex20k
205a563b65
Allow wildcard routes for nonproxy admin (SCIM) (#17178)
* checked for wildcards in nonproxy

* ready
2025-11-27 22:10:19 -08:00
Andy Forest
8aa4f3d476
fix(bedrock): handle cohere v4 embed response dictionary format (#17220) 2025-11-27 21:50:35 -08:00
Saar wintrov
87050c6a02
SSO: fix the generic SSO provider (#17227)
* SSO: fix the generic SSO provider

* adding tests
2025-11-27 21:27:23 -08:00
YutaSaito
334d09b3b2
feat: add regex-based tool_name/tool_type matching for tool-permission (#17164)
* feat: add regex-based tool_name/tool_type matching for tool-permission

* docs: update tool permission quick start for UI workflow
2025-11-27 21:26:27 -08:00
Wei-Chiet Ku
d43c077653
Fix/issue 16759 streaming error validation (#17242)
* Enhance error handling in OpenAIResponsesAPIConfig to coalesce null error codes into a default string, preventing validation errors and improving stability during streaming iterations.

* Add test for coalescing null error codes in streaming responses

This test ensures that when a streaming error event has error.code set to None, the system correctly transforms it to 'unknown_error' and returns an ErrorEvent instance without raising a ValidationError.

---------

Co-authored-by: Ku Wei Chiet <chietkuw@fpt.com>
2025-11-27 21:24:04 -08:00
Sameer Kankute
71f41352fa
Merge pull request #17202 from BerriAI/litellm_azure_ai_anthropic_support
(Bug)Migrate Anthropic provider to azure ai
2025-11-28 08:14:14 +05:30
yuneng-jiang
a33a2cb5b5 Adding timeout to flaky test 2025-11-27 17:53:09 -08:00
yuneng-jiang
bed3006d94 Merge remote-tracking branch 'origin' into litellm_add_model_fix_team_admin 2025-11-27 17:32:09 -08:00
yuneng-jiang
25e2331510 Merge remote-tracking branch 'origin' into litellm_ui_callback_fix 2025-11-27 17:29:29 -08:00
yuneng-jiang
2d9acb2237 Merge remote-tracking branch 'origin' into litellm_non_root_docker_logo_fix 2025-11-27 17:27:47 -08:00
Ishaan Jaff
edfc35ddac
[Feature]: Add Provider publicai.co (#17230)
* init PublicAIChatConfig

* add publicai

* init public ai

* add publicai

* add publicai/swiss-ai models etc
2025-11-27 13:08:03 -08:00
Ishaan Jaff
38ddd50628
[Bug fix] Vector Store List Endpoint Returns 404 (#17229)
* fix vector store management

* fix: add vector_store_management_router

* TestVectorStoreManagementEndpointsExist

* fix pass_through
2025-11-27 12:51:51 -08:00
Ishaan Jaff
d612d71ef4
[Feat] Add guardrails for pass through endpoints (#17221)
* add PassThroughGuardrailsConfig

* init JsonPathExtractor

* feat PassthroughGuardrailHandler

* feat pt guardrails

* pt guardrails

* add Pass-Through Endpoint Guardrail Translation

* add PassThroughEndpointHandler

* execute simple guardrail config and dict settings

* TestPassthroughGuardrailHandlerNormalizeConfig

* add passthrough_guardrails_config on litellm logging obj

* add LiteLLMLoggingObj to base trasaltino

* cleaner _get_guardrail_settings

* update guardrails settings

* docs pt guardrail

* docs Guardrails on Pass-Through Endpoints

* fix typing

* fix typing

* test_no_fields_set_sends_full_body

* fix typing

* Potential fix for code scanning alert no. 3834: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-11-27 12:06:53 -08:00
Sameer Kankute
9669f33b39 fix tests/test_litellm/llms/azure_ai/claude/test_azure_anthropic_handler.py 2025-11-27 22:59:29 +05:30
Sameer Kankute
cf6dda5e29 block input_examples in fucntion definition for non anthropic providers 2025-11-27 22:46:28 +05:30
Ishaan Jaffer
96a0f960a9 test_e2e_batches_files 2025-11-27 09:14:43 -08:00
Ishaan Jaff
31ecd4ce49
Revert "Respect custom llm provider in header" (#17211) 2025-11-27 09:12:44 -08:00
Sameer Kankute
83c1138067
Merge pull request #17195 from BerriAI/litellm_respect_custom_llm_header
Respect custom llm provider in header
2025-11-27 22:27:42 +05:30
Sameer Kankute
5fc950ec05 migrate anthropic provider to azure ai provider 2025-11-27 19:47:54 +05:30
abbas jafari
af5f31eb9f
Merge branch 'BerriAI:main' into main 2025-11-27 14:46:15 +01:00
Sameer Kankute
1f6d8fc151
Merge pull request #17079 from naaa760/fix/vertex-batch-support
fix: support Vertex AI batch listing in LiteLLM proxy
2025-11-27 16:50:17 +05:30
Sameer Kankute
d4bc1cf23d Respect custom llm provider in header 2025-11-27 16:38:37 +05:30
Sameer Kankute
247160277e Added support for twelvelabs pegasus 2025-11-27 15:46:04 +05:30