yucheng-berri 7ff5010674 feat(guardrails): split logging_only_scope direction from input-failure policy (#45709) ... * feat(guardrails): split logging_only_scope direction from input-failure policy logging_only_scope is now direction-only (input, output, unset for both directions). The new logging_only_continue_on_input_failure flag controls whether a flagged or raising logging_only input scan still lets the response be scanned. "both" stays accepted everywhere as a deprecated alias for unset scope plus the flag set to true, normalized at callback init while stored rows keep the written value. Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(dashboard): narrow continue-on-input-failure update type and stay under guardrail_info max-lines Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(dashboard): keep custom-code guardrail controls readable with logging_only Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(dashboard): scope continue-on-input-failure to the default direction and restore verdict assertion Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * refactor(guardrails): remove the both value from logging_only_scope logging_only_scope only shipped its both value in dev prereleases, so it is dropped instead of kept as a deprecated alias. Leaving the scope unset and setting logging_only_continue_on_input_failure gives the same behavior. A stored both value is now treated like any other invalid scope: it is logged and ignored on load, and rejected with 422 on create or update. * fix(guardrails): tolerate an invalid logging_only_scope in the v1 guardrail list A config.yaml guardrail whose logging_only_scope is no longer valid, such as the removed both value, made GET /guardrails/list return 500 for every guardrail. The v1 list now parses params with the same tolerant parser as the v2 list, info and PATCH paths, so the bad value is logged and dropped. * test(guardrails): drive continue-flag rejection tests through the real guardrail handler --------- Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: yucheng-berri <293926326+yucheng-berri@users.noreply.github.com>		2026-10-10 01:46:39 -07:00
..
arize	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
azure_storage	fix(azure_storage): keep client call ids from sharing one Data Lake file (#44099)	2026-10-01 23:23:37 -07:00
bitbucket	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
cloudzero	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
code_interpreter_interception	fix(websearch_interception): drop stream_options when forcing stream=False and replay it on the final stream (#45433)	2026-10-09 22:16:02 -07:00
compression_interception	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
datadog	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
dotprompt	test: finish the non-proxy half of tests/test_litellm (#43281)	2026-09-25 22:43:41 -07:00
focus	refactor(proxy): inject one UTC clock read per operation into gateway tracking, PTU rollup and Mavvrik export (#45520)	2026-10-09 00:15:38 -07:00
gcs_bucket	test: move offline proxy auth, hook, spend and pass-through tests to tests/unit (#45568)	2026-10-09 09:49:13 -07:00
gcs_pubsub	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
generic_api	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
gitlab	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
helicone	test: add __init__.py to migrated tests/unit packages	2026-09-20 11:53:49 +00:00
langfuse	test: move offline logging, secret manager and provider tests from legacy dirs into tests/unit (#45554)	2026-10-09 09:48:10 -07:00
levo	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
litellm_agent	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
mavvrik_focus	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
newrelic	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
open_telemetry	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
opik	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
otel	fix: support OpenAI SDK 3 while retaining SDK 2 compatibility (#44927)	2026-10-09 19:45:50 -07:00
pointfive	chore(lint): remove the LIT002 mutable-construction rule (#43971)	2026-10-01 12:24:02 -07:00
SlackAlerting	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
vector_store_integrations	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
websearch_interception	fix(websearch_interception): drop stream_options when forcing stream=False and replay it on the final stream (#45433)	2026-10-09 22:16:02 -07:00
zerobus	test(zerobus): move tests into active CI selection (#43235)	2026-09-25 23:35:15 +00:00
__init__.py	test: add __init__.py to migrated tests/unit packages	2026-09-20 11:53:49 +00:00
conftest.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
rubrik_test_helpers.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_adaptive_concurrency.py	fix(s3_v2): upload fresh events first, drop terminal failures and hour-old retries by default, opt-in adaptive concurrency (#43022)	2026-09-26 14:58:28 -07:00
test_agentops.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_anthropic_cache_control_hook.py	fix(responses): keep a flagged hosted deployment's prompt cache breakpoint on the chat bridge (#45500)	2026-10-09 04:00:39 -07:00
test_athina.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_azure_sentinel.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_braintrust_logging.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_braintrust_span_name.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_custom_guardrail.py	feat(guardrails): split logging_only_scope direction from input-failure policy (#45709)	2026-10-10 01:46:39 -07:00
test_custom_guardrail_recursion.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_custom_logger.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_custom_prompt_management.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_deepeval.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_galileo.py	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
test_guardrail_logging_sync.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_helicone.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_humanloop.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_langfuse.py	test: move offline logging, secret manager and provider tests from legacy dirs into tests/unit (#45554)	2026-10-09 09:48:10 -07:00
test_langfuse_otel.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_langsmith.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_langsmith_init.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_lunary.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_mlflow.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_openmeter.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_opentelemetry.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_opentelemetry_dynamic_imports.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_opentelemetry_request_spans.py	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
test_opik_utils.py	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
test_otel_guardrail_violation_spans.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_otel_team_attributes_matrix.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_posthog.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_prometheus_api_promql_escape.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_budget_metric_guard.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_budget_metrics_db_lookups.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_budget_metrics_timeout.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_cache_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_caller_identity.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_carried_budget_state.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_client_ip_user_agent.py	feat(prometheus): expose per-project per-model rate limit allowed and used gauges (#43561)	2026-10-08 12:03:29 -05:00
test_prometheus_custom_metadata_label_counts.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_deployment_state_proxy_rejects.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_end_user_cardinality.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_input_sequence_length_label.py	feat(ui): add auto-router usage and savings table (#45152)	2026-10-07 15:04:07 -07:00
test_prometheus_invalid_key_filtering.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_labels.py	fix(prometheus): add model_group label to end-to-end latency metrics (#44860)	2026-10-07 11:18:45 -07:00
test_prometheus_mcp_tool_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_media_generation_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_metric_name_consistency.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_metrics_endpoint.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_missing_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_none_metadata.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_overhead_with_guardrails.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_queue_guardrail_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_rate_limit_labels.py	feat(prometheus): expose per-project per-model rate limit allowed and used gauges (#43561)	2026-10-08 12:03:29 -05:00
test_prometheus_remaining_tokens_router_fallback.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_requested_model_cardinality.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_series_cardinality.py	feat(prometheus): cap series per metric for every labeled metric (#44420)	2026-10-06 01:28:44 +00:00
test_prometheus_service_tier_label.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_services.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_prometheus_spend_capture_rate.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_spend_logs_metadata.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_stream_label.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_token_detail_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_user_team_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_zero_cost_metric.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prompt_manager_ssti.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_responses_background_cost.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_rubrik.py	feat(guardrails): honor litellm_params.timeout in every HTTP guardrail (#43134)	2026-09-30 21:18:47 -07:00
test_s3.py	feat(s3_v2): add s3_partition_granularity option for hourly S3 folders (#43748)	2026-10-01 11:00:21 -07:00
test_s3_v2.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_shadow_eval_logger.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_sqs.py	test: move offline logging, secret manager and provider tests from legacy dirs into tests/unit (#45554)	2026-10-09 09:48:10 -07:00
test_wandb.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_weave_otel.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00