Andrew Bernat
d89990e0c5
Add license metadata to health/readiness endpoint. ( #15997 )
...
* health: expose license metadata (available & expiration) in /health/readiness endpoint
* test: add health readiness license metadata coverage
* test: ensure /health/readiness response includes license metadata
* chore: remove standalone license metadata test as requested; existing test covers codepath
---------
Co-authored-by: Plan42.ai <robot@plan42.ai>
2025-10-28 19:21:54 -07:00
Ishaan Jaffer
33371d18f4
test fix claude-sonnet-4-5-20250929
2025-10-28 19:05:13 -07:00
Ishaan Jaffer
b0a2e08a60
fixes test
2025-10-28 17:43:04 -07:00
Ishaan Jaffer
d32890ba55
fix _redact_base64
2025-10-28 17:38:16 -07:00
Ishaan Jaffer
1b49dba1dd
fix claude-sonnet-4-5
2025-10-28 17:37:08 -07:00
Ishaan Jaffer
74e4d3f6da
fixes for mock tests
2025-10-28 17:31:54 -07:00
Sameer Kankute
8f2becd1c4
Fix: Redact reasoning summaries in ResponsesAPI output when message logging is disabled ( #15965 )
...
* redact reasoning content as well
* fix mypy error
2025-10-28 16:42:41 -07:00
Ishaan Jaff
ab8a3a5d9e
[Fix] SQS Logger - Add Base64 handling ( #16028 )
...
* Enable base64 stripping from sqs (#15927 )
* Add sqs logger
* Add sqs logger
* Add sqs strp base64
* Add sqs strp base64
* Add sqs strp base64
* strip base64
* Add sqs strp base64
* strip base64
* Add sqs strp base64
* Add max depth recursion
* Add max depth recursion
---------
Co-authored-by: deepanshu <deepanshu.lulla@hq.bill.com>
* refactor _strip_base64_from_messages
* test fixes SQS logger
* fix SQS linting
---------
Co-authored-by: Deepanshu Lulla <deepanshu.lulla@gmail.com>
Co-authored-by: deepanshu <deepanshu.lulla@hq.bill.com>
2025-10-28 16:41:32 -07:00
Ishaan Jaff
95dd216150
[UI] Feature - Add Apply Guardrail Testing Playground ( #16030 )
...
* add applyGuardrail endpoints
* v0 testing apply guard
* fix: use tabs
* move apply guardrails endpoint
* fix apply_guardrail
* fix applyGuardrail
* fix apply guardrail for bedrock
* test guard endpoints
* add tooltip for enter button
* refactor
* add guardrail test
* tests guardrails selector
* TestNomaApplyGuardrail
2025-10-28 16:41:17 -07:00
Ishaan Jaff
5c375b23ae
[Fix] Guardrails - Ensure Key Guardrails are applied ( #16025 )
...
* _add_guardrails_from_key_or_team_metadata
* test_team_guardrails_append_to_key_guardrails
* fix move_guardrails_to_metadata
* fix _add_guardrails_from_key_or_team_metadata
2025-10-28 16:40:49 -07:00
Deepanshu Lulla
3a7c498eff
Add GitlabPromptCache and enable subfolder access ( #15712 )
...
* Add GitlabPromptCache and enable subfolder access
* Add GitlabPromptCache and enable subfolder access
* Add GitlabPromptCache and enable subfolder access
---------
Co-authored-by: deepanshu <deepanshu.lulla@hq.bill.com>
2025-10-28 14:46:50 -07:00
Ariel
647f2f5d86
[feat]: graceful degradation for pillar service when using litellm ( #15857 )
...
* graceful degradation for pillar service when using litellm
* remove unnecessary mode
* simplify docs
* final fixes
* lint fixes
* fix linting
2025-10-27 19:51:29 -07:00
Katsuhiro Muto
2074b4d662
Fix: Support tool usage messages with Langfuse OTEL integration ( #15932 )
...
* Log tool use in langfuse otel integration
* Add test for logging function calling
---------
Co-authored-by: eycjur <eycjur@example.com>
2025-10-27 19:47:31 -07:00
Chris Gibbons
2bef7c3662
fix: Preserve Bedrock inference profile IDs in health checks ( #15947 )
...
* fix: Preserve Bedrock inference profile IDs in health checks
- Fixes issue where health checks were stripping inference profile IDs
- Preserves cross-region inference profile prefixes (us., eu., apac., jp., au., us-gov., global.)
- Strips only AWS region routing while preserving routes and handlers
- Resolves both issue #15807 and inference profile requirement errors
- Adds comprehensive tests for all Bedrock model format combinations
Issue #15807 attempted to fix regional Bedrock model health checks but was too
aggressive, stripping cross-region inference profile prefixes that AWS requires.
This caused errors: "Invocation of model ID X with on-demand throughput isn't
supported. Retry your request with the ID or ARN of an inference profile."
The fix now correctly:
- Strips AWS regions (us-west-2, eu-central-1, etc.) from routing
- Preserves CRIS prefixes (us., eu., etc.) required by AWS
- Preserves routes (converse/, invoke/)
- Preserves handlers (llama/, deepseek_r1/)
- Only affects Bedrock models (checked via startswith)
Test coverage includes 20+ scenarios for all Bedrock model format combinations.
* Remove unused traceback import
2025-10-27 19:44:45 -07:00
YutaSaito
8b33328cc1
Perf speed up pytest ( #15951 )
...
* perf: Skip sleep delays in base_mail.py during tests to improve test speed
* perf: Mock datetime.now in parallel_request_limiter_v3.py to improve test speed
* pref: Mock urllib system calls in test_aiohttp_transport.py to improve test speed
* chore: add --durations=50 to visualize slowest tests
* pref: reduce setup phase overhead by widening fixture scope in conftest.py
* test: stabilize flaky tests
* fix: minor issue
2025-10-27 19:43:40 -07:00
Ishaan Jaff
4cef208c5f
[Fix] - Responses API - add /openai routes for responses API. (Azure OpenAI SDK Compatibility) ( #15988 )
...
* add /openai routes for responses API
* TestResponsesAPIEndpoints
2025-10-27 19:12:13 -07:00
Ishaan Jaffer
a3d64fb843
fix omni-moderation-latest
2025-10-27 17:48:35 -07:00
Ishaan Jaffer
1acc321eb3
test_router_amoderation
2025-10-27 13:50:32 -07:00
Ishaan Jaffer
2d836dfb6d
test_basic_moderations_on_proxy_with_model
2025-10-27 13:49:47 -07:00
Ishaan Jaffer
cb57455172
test_foward_litellm_user_info_to_backend_llm_call
2025-10-27 13:48:23 -07:00
Sameer Kankute
59df75276c
Fix: Respect LiteLLM-Disable-Message-Redaction header for Responses API ( #15966 )
...
* fix overide for logging unredacted messages
* Use _get_metadata_variable_name_from_kwargs
* fix test related to redaction
2025-10-27 13:46:21 -07:00
Ishaan Jaff
0bb53f5048
[Fix] Azure OpenAI - Add handling for v1 under azure api versions ( #15984 )
...
* fix _is_azure_v1_api_version
* test_is_azure_v1_api_version
2025-10-27 13:45:44 -07:00
Ishaan Jaff
17f6238d2b
[Feat] OTEL - Ensure error information is logged on OTEL ( #15978 )
...
* fix _record_exception_on_span
* _record_exception_on_span
* test_record_exception_on_span
* fix linting errors
2025-10-27 13:45:21 -07:00
Ishaan Jaff
02df4c6b30
[Fix] DD logging - ensure key's metadata + guardrail is logged on DD ( #15980 )
...
* fix get_sanitized_user_information_from_key
* test_get_sanitized_user_information_from_key_includes_guardrails_metadata
2025-10-27 13:45:09 -07:00
Ishaan Jaff
20f9e189fb
[Buf fix] - Azure OpenAI, fix ContextWindowExceededError is not mapped from Azure openai errors ( #15981 )
...
* fix is_error_str_context_window_exceeded
* test_is_error_str_context_window_exceeded
2025-10-27 13:44:55 -07:00
pinkgu
4758e2998b
feat: support during_call for model armor guardrails ( #15970 )
...
Signed-off-by: bjornjee <bjornjee95@gmail.com>
2025-10-27 13:34:59 -07:00
YutaSaito
c0890e7d33
[Feat] add support for dynamic client registration ( #15921 ) (enables Atlassian MCP to work via Oauth on LiteLLM)
...
* feat: add support for dynamic client registration #13856
* fix: test
* feat: return 401 when oauth2_header is missing for OAuth2-based MCP servers
2025-10-26 10:13:46 -07:00
Katsuhiro Muto
d8b44f4dbf
Enable OpenTelemetry context propagation by external tracers ( #15940 )
...
* Fix: Enable OpenTelemetry context propagation with external tracers
* Add test for handling external tracers
* change priority to get tracer
---------
Co-authored-by: eycjur <eycjur@example.com>
2025-10-26 10:09:54 -07:00
Ishaan Jaffer
4fc692d1e3
TestGooglePSESearch
2025-10-25 17:13:45 -07:00
Ishaan Jaffer
cd0db19750
unstable test
2025-10-25 17:11:13 -07:00
Ishaan Jaffer
cbadcd4a77
TestPerplexityIntegration
2025-10-25 17:06:01 -07:00
Ishaan Jaffer
04ff660276
fixes exception handling
2025-10-25 16:55:16 -07:00
Ishaan Jaffer
bbfddd00e4
test fix
2025-10-25 16:46:29 -07:00
Ishaan Jaffer
a1d3790198
TestAzureResponsesAPITest
2025-10-25 16:22:52 -07:00
Krrish Dholakia
0f7e1acfc6
test: update tests
2025-10-25 16:14:19 -07:00
Krrish Dholakia
3c0df6a2da
test: update unit testing
2025-10-25 16:09:53 -07:00
Ishaan Jaffer
f0ae2bef4f
TestAzureResponsesAPITest
2025-10-25 16:09:04 -07:00
Ishaan Jaffer
4341495508
search test fix credits
2025-10-25 16:05:44 -07:00
Ishaan Jaffer
3bd42b7ccf
test_image_generation_azure_dall_e_3
2025-10-25 15:47:40 -07:00
Krrish Dholakia
da3988b768
fix: fix test
2025-10-25 15:43:16 -07:00
Ishaan Jaffer
a9c7fbbb60
test_router_init
2025-10-25 15:14:18 -07:00
Ishaan Jaffer
679374fe79
test_img_gen_on_router
2025-10-25 15:11:52 -07:00
Ishaan Jaffer
ab0fc0a30d
test_aimg_gen_on_router
2025-10-25 15:11:21 -07:00
Ishaan Jaffer
20d8345a7c
test: fixes because azure deactivated our account
2025-10-25 15:10:45 -07:00
Ishaan Jaffer
e878f2b1ef
test_router_get_available_deployments
2025-10-25 15:09:08 -07:00
Ishaan Jaffer
e67e4b893d
test_completion_azure_ai_gpt_4o_with_flexible_api_base
2025-10-25 14:59:11 -07:00
Ishaan Jaffer
5cca4c8b4f
test_image_generation_openai
2025-10-25 14:57:40 -07:00
Ishaan Jaffer
2c52791b83
test_model_function_invoke
2025-10-25 14:56:12 -07:00
Ishaan Jaffer
667f2613de
TestAzureOpenAIVectorStore
2025-10-25 14:06:28 -07:00
Krish Dholakia
346e036399
fix(opentelemetry.py): fix issue where headers were not being split correctly + feat(bedrock): add titan image generations w/ cost tracking ( #15916 )
...
* fix(opentelemetry.py): fix issue where headers were not being split correctly
* feat(bedrock/image): Support bedrock titan image generation
Closes https://github.com/BerriAI/litellm/issues/361
* build(model_prices_and_context_window.json): track titan image gen pricing
enables cost tracking per request
* feat(amazon_titan_transformation.py): support titan image generation cost tracking
* docs: document new model
* docs: update docs to indicate cost tracking + refactor rerank into separate doc
* fix: fix mypy linting error
* fix: fix type ignore
2025-10-25 13:45:13 -07:00
