Commit graph

28013 commits

Author SHA1 Message Date
rioiart
70126d9130
Fix/new org team validate against org (#17333)
* fix: skip user budget/model validation for org-scoped teams

When creating a team with organization_id, budget and model constraints
should be validated against the organization's limits, not the user's
personal limits. This allows org admins with restrictive personal
budgets to create teams within their organization's more generous limits.

Adds 4 unit tests to verify:
- Org-scoped teams bypass user budget validation
- Org-scoped teams bypass user model validation
- Standalone teams still validate against user limits

* fix: enforce user budget/model limits for standalone teams in update_team

- Add user-level budget and model validation to update_team endpoint for standalone teams,
  matching the existing pattern in new_team
- Org-scoped teams correctly bypass user validation and use organization limits instead
- Add 5 new comprehensive tests covering standalone/org team budget/model validation

* fix: Add direct TPM/RPM org limit validation and consolidate user team limit checks

- Add direct TPM/RPM comparison against org limits in _check_org_team_limits()
- Consolidate budget/models/TPM/RPM user validation into _check_user_team_limits() helper
- Ensure user limits only apply to standalone teams (organization_id=None)
- Org-scoped teams now validate TPM/RPM against org limits (not user limits)
- Add 8 tests for TPM/RPM validation scenarios (org and user limits)
- Reduce code duplication between new_team() and update_team()
2025-12-01 19:51:42 -08:00
Ishaan Jaff
1cdfb3da8f
[Bug Fix] - Fix litellm_enterprise ensure imported routes exist (#17337)
* test_enterprise_routes.py

* test_enterprise_routes_all_imports_exist
2025-12-01 19:14:12 -08:00
Sameer Kankute
289c13ca5d
Merge pull request #17260 from abi-jey/main
fix: GA path for azure openai realtime models
2025-12-02 08:34:10 +05:30
Sameer Kankute
dbf1cd591d
Merge pull request #17271 from colinlin-stripe/cherry-pick-invoke-headers
[fix] extra_headers in messages api bedrock invoke
2025-12-02 08:26:54 +05:30
Ishaan Jaff
860cdc81d3
[Fix] Fix Watsonx Audio Transcription API (#17326)
* """
add

* fix transform_audio_transcription_request

* fix tests

* test_watsonx_transcription_request_body
2025-12-01 18:26:56 -08:00
Elias
37ecb03d4f
Add support of audio transcription for OVHcloud (#17305) 2025-12-01 18:26:39 -08:00
Danny Kopping
be920d75d3
Add claude-opus-4-5 alias (#17313)
Similar to `claude-sonnet-4-5`.
2025-12-01 18:25:26 -08:00
Krish Dholakia
1eb06f8031
Revert "fix: respect guardrail mock_response during during_call to return blo…" (#17332)
This reverts commit 6de6107673.
2025-12-01 15:40:28 -08:00
Krish Dholakia
b6d6f834e0
(feat) Generic Guardrail API - allows guardrail providers to add INSTANT support for LiteLLM w/out PR to repo (#17175)
* feat(generic_guardrail_api.py): new generic api for guardrails

Allows guardrail providers to work with litellm for guardrails without needing to make a PR to LiteLLM

* docs(generic_guardrail_api.md): document new generic guardrail api

* Fix: Improve PII detection and guardrail API integration

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* feat: correctly extract raw request from guardrail api

* docs(generic_guardrail_api.md): document this is a beta feature

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-12-01 14:29:52 -08:00
Ishaan Jaff
f434ca61ec
add kimi-k2-instruct-0905 (#17328) 2025-12-01 14:14:41 -08:00
Krrish Dholakia
c9afb86994 docs(azure_ai.md): document anthropic model usage on azure ai 2025-12-01 14:06:31 -08:00
Krrish Dholakia
7a46f3a083 docs: document azure ai provider for anthropic 2025-12-01 14:05:54 -08:00
Ishaan Jaff
24f847b84c
[Feat] JWT Auth - AI Gateway, allow using regular OIDC flow with user info endpoints (#17324)
* feat: allow fetching OIDC user info

* test: use test_auth_builder_with_oidc_userinfo_enabled gets user info when enabled

* fix tool permission doc

* docs fix diagram
2025-12-01 13:59:00 -08:00
Ishaan Jaff
ce0dc0c8b9
[Feat] WatsonX - allow passing zen_api_key dynamically (#16655)
* test_watsonx_zen_api_key_from_client

* zen api key

* docs using zen api key
2025-12-01 12:55:47 -08:00
YutaSaito
a73bd751fc
doc: add images for tool permission guardrail (#17322) 2025-12-01 12:38:49 -08:00
Colin Lin
661bccbc39 fixed flaky test by sorting list 2025-12-01 14:26:14 -05:00
Colin Lin
e420b633a1 add tests 2025-12-01 14:25:37 -05:00
Colin Lin
2a5082e6cf remove logs 2025-12-01 14:25:37 -05:00
Colin Lin
c588e7854d use kwargs 2025-12-01 14:25:37 -05:00
orgersh92
7808a610f8
Fix session consistency, move Lasso API version away from source code (#17316)
* store and fetch lasso-conversation id from cache

* include gateway/v# in the baseUrl to allow simpler version migrations in the future

* add tests for cached conversation ID
2025-12-01 10:03:51 -08:00
YutaSaito
6de6107673
fix: respect guardrail mock_response during during_call to return blocked output (#17247) 2025-12-01 09:59:01 -08:00
Sameer Kankute
3347e4de11
Merge pull request #17292 from BerriAI/litellm_gemini_image_gen_handling
Add better handling in image generation for gemini models
2025-12-01 21:42:36 +05:30
Sameer Kankute
353c779c34
Merge pull request #17301 from BerriAI/litellm_claude_code_beta_fix
Remove not compatible beta header from Bedrock
2025-12-01 21:39:37 +05:30
Sameer Kankute
8d1113eac1
Merge pull request #17296 from BerriAI/litellm_video_passthrough_cost_tracking
(Feat)Add passthrough cost tracking for veo
2025-12-01 21:33:03 +05:30
Sameer Kankute
983ba7aa0f Remove not compatible beta header from claude code 2025-12-01 17:22:04 +05:30
Sameer Kankute
ae132abff4 Revert auth change 2025-12-01 14:36:30 +05:30
Sameer Kankute
7dac498efb Add passthrough cost tracking for veo 2025-12-01 14:33:03 +05:30
Sameer Kankute
02510a908f Add better handling image generation for gemini models 2025-12-01 10:42:38 +05:30
Sameer Kankute
07434092f8
Merge pull request #17290 from BerriAI/litellm_fix_create_batch_Header
Respect custom llm provider in header
2025-12-01 08:37:50 +05:30
Sameer Kankute
f7380a51de Respect custom llm provider in header 2025-12-01 08:36:29 +05:30
Alexsander Hamir
b949ec90db
Merge pull request #16739 from BerriAI/litellm_/audio/speech
[Perf] Fix `/audio/speech` performance by using `shared_sessions`
2025-11-30 17:27:44 -08:00
Alexsander Hamir
4fffd33ccf
Merge pull request #17167 from BerriAI/litellm_spend_logs_api
[Refactor] Deprecate `spend/logs` & add `spend/logs/v2`
2025-11-29 06:19:53 -08:00
Sameer Kankute
7f42b9b987
Merge pull request #17193 from BerriAI/litellm_twelvelabs_int
Added support for twelvelabs pegasus
2025-11-28 22:09:00 +05:30
hxomer
b85df0b1fb
Better handle anonymization (#17207)
* Better handle anonymization

* Fix tests
2025-11-28 08:22:19 -08:00
Sameer Kankute
9d058398df Fix pegasus response and add doc 2025-11-28 21:41:25 +05:30
Sameer Kankute
bcc35a6069
Merge pull request #17253 from BerriAI/litellm_nova_embedding_support
Add nova embedding support
2025-11-28 21:16:06 +05:30
Sameer Kankute
bb11c4fb3f
Merge pull request #17258 from BerriAI/litellm_add_tags_in_ui
Fix metadata tags and model name display in UI for Azure passthrough + Add cost tracking for responses API
2025-11-28 21:15:39 +05:30
Sameer Kankute
af8f1475bf fix PLR0915 2025-11-28 21:12:42 +05:30
Sameer Kankute
6c326ceb87
Merge pull request #17142 from BerriAI/litellm_anthropic_update_new_feat
Update new anthropic feats as reviewed
2025-11-28 21:06:34 +05:30
abbas jafari
23b737d2a4
Merge branch 'BerriAI:main' into main 2025-11-28 15:28:52 +01:00
abi_jey
4cf7a74e60 fix: Azure OpenAI GA path relies soley on model paramter as deployment 2025-11-28 14:27:57 +00:00
Sameer Kankute
eab0ec95f0 Fix async get request 2025-11-28 18:06:53 +05:30
Sameer Kankute
f0d3c96a8d Add tags and other field in UI logs and add responses api cost tracking 2025-11-28 17:23:15 +05:30
Sameer Kankute
8700c5ced6 Add nova embedding support 2025-11-28 14:56:46 +05:30
v0rtex20k
205a563b65
Allow wildcard routes for nonproxy admin (SCIM) (#17178)
* checked for wildcards in nonproxy

* ready
2025-11-27 22:10:19 -08:00
Omkar Malpure
bbea83fd93
Fix : acompletion throws error with SambaNova models (#17217)
Co-authored-by: Omkar Malpure <omkarmalpure@Omkars-MacBook-Pro.local>
2025-11-27 21:59:24 -08:00
Andy Forest
8aa4f3d476
fix(bedrock): handle cohere v4 embed response dictionary format (#17220) 2025-11-27 21:50:35 -08:00
Saar wintrov
87050c6a02
SSO: fix the generic SSO provider (#17227)
* SSO: fix the generic SSO provider

* adding tests
2025-11-27 21:27:23 -08:00
YutaSaito
334d09b3b2
feat: add regex-based tool_name/tool_type matching for tool-permission (#17164)
* feat: add regex-based tool_name/tool_type matching for tool-permission

* docs: update tool permission quick start for UI workflow
2025-11-27 21:26:27 -08:00
Wei-Chiet Ku
d43c077653
Fix/issue 16759 streaming error validation (#17242)
* Enhance error handling in OpenAIResponsesAPIConfig to coalesce null error codes into a default string, preventing validation errors and improving stability during streaming iterations.

* Add test for coalescing null error codes in streaming responses

This test ensures that when a streaming error event has error.code set to None, the system correctly transforms it to 'unknown_error' and returns an ErrorEvent instance without raising a ValidationError.

---------

Co-authored-by: Ku Wei Chiet <chietkuw@fpt.com>
2025-11-27 21:24:04 -08:00