devin-ai-integration[bot] fa6b209165 feat(guardrails): add only_scan_new_messages for per-session incremental scanning (#33278) ... * feat(guardrails): add only_scan_new_messages for per-session incremental scanning Co-Authored-By: Ishaan Jaffer <155045088+ishaan-berri@users.noreply.github.com> * fix(guardrails): use fixed TTL constant and revert unrelated test formatting Co-Authored-By: Ishaan Jaffer <155045088+ishaan-berri@users.noreply.github.com> * fix(guardrails): run only_scan_new_messages in the unified apply_guardrail path The initial wiring lived in BedrockGuardrail.async_pre_call_hook, but the proxy routes Bedrock through the unified apply_guardrail interface, so the flag had no effect live. Move incremental selection into apply_guardrail: filter the flat texts list against per-session scanned hashes, skip the Bedrock call when nothing is new, and mark hashes only after a successful (non-blocked) scan. Full-context fallback is preserved when there is no session id, the cache is unavailable, or a masking guardrail is configured. Co-Authored-By: Ishaan Jaffer <155045088+ishaan-berri@users.noreply.github.com> * test(guardrails): cover session-id fallbacks and mark_texts_scanned guards Co-Authored-By: Ishaan Jaffer <155045088+ishaan-berri@users.noreply.github.com> * fix(guardrails): fall back to full scan when incremental guardrail masks content, use shared cache Co-Authored-By: Ishaan Jaffer <155045088+ishaan-berri@users.noreply.github.com> * test(guardrails): cover generic agent multi-turn incremental scan Co-Authored-By: Ishaan Jaffer <155045088+ishaan-berri@users.noreply.github.com> * test(guardrails): cover incremental scan cache resolver fallbacks Co-Authored-By: Ishaan Jaffer <155045088+ishaan-berri@users.noreply.github.com> * test(guardrails): cover flag interactions and /v1/messages incremental scan semantics * feat(guardrails): make GUARDRAIL_SCANNED_MESSAGES_CACHE_TTL_SECONDS env configurable * test(guardrails): prove skip_system/skip_tool are enforced upstream of incremental scan --------- Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: Ishaan Jaffer <155045088+ishaan-berri@users.noreply.github.com> Co-authored-by: Yucheng Zhu <yucheng@berri.ai>		2026-07-22 09:56:59 -07:00
..
arize	feat(arize/phoenix): OpenInference rendering parity — tool_calls, cost, passthrough I/O, session/user, multimodal, cache tokens (#28800)	2026-06-03 12:09:50 -07:00
azure_storage	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
bitbucket	fix: block path traversal SSRF in BitBucket, Arize Phoenix, and AssemblyAI clients (#26943)	2026-05-01 11:45:12 -07:00
cloudzero	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
code_interpreter_interception	feat(sandbox): reuse e2b container across requests when metadata.session_id is set (#31688)	2026-06-30 18:58:09 -07:00
compression_interception	feat(spend): track prompt compression saved tokens in daily spend aggregates (#33810)	2026-07-18 17:47:54 -07:00
datadog	fix(datadog): split log batches proactively under intake payload limits (#32860)	2026-07-10 20:54:42 -07:00
dotprompt	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
focus	chore: litellm oss staging (#31185)	2026-06-26 09:17:44 -07:00
gcs_bucket	fix cloud storage file guards	2026-05-01 15:34:11 -07:00
gcs_pubsub	Litellm fix GitHub action testing (#11163)	2025-05-26 14:41:42 -07:00
gitlab	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
langfuse	Litellm oss staging 050626 (#29774)	2026-06-05 13:51:51 -07:00
levo	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
litellm_agent	Agent Builder - support new experimental agent builder, to ensure agents pass compliance checks (#21817)	2026-02-21 15:32:47 -08:00
mavvrik_focus	chore: litellm oss staging (#31185)	2026-06-26 09:17:44 -07:00
newrelic	feat: litellm oss 110626 (#30202)	2026-06-11 22:30:26 -07:00
open_telemetry	fix(otel): capture 401 error details in management endpoint spans (#29535)	2026-06-02 16:40:30 -07:00
opik	Litellm oss staging 030626 (#29578)	2026-06-03 11:01:51 -07:00
otel	fix(otel): restore proxy-level error.* attributes on v2 failure spans (LIT-4179) (#33664)	2026-07-18 10:52:27 -07:00
SlackAlerting	chore(oss): litellm oss staging 120626 (#30292)	2026-06-12 09:49:25 -07:00
websearch_interception	fix(websearch): address Responses review findings	2026-07-15 00:52:16 +00:00
rubrik_test_helpers.py	Litellm oss staging 04 21 2026 2 (#26569)	2026-05-20 21:25:19 -07:00
test_agentops.py	Litellm fix GitHub action testing (#11163)	2025-05-26 14:41:42 -07:00
test_anthropic_cache_control_hook.py	fix(anthropic): carry the stand-down judgment inside written-back injection points	2026-07-18 17:11:03 -07:00
test_athina.py	Litellm fix GitHub action testing (#11163)	2025-05-26 14:41:42 -07:00
test_azure_sentinel.py	fix(azure_sentinel): resolve audit stream from AZURE_SENTINEL_AUDIT_STREAM_NAME (#32010)	2026-07-03 12:09:27 -07:00
test_braintrust_logging.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_braintrust_span_name.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_custom_guardrail.py	feat(guardrails): add only_scan_new_messages for per-session incremental scanning (#33278)	2026-07-22 09:56:59 -07:00
test_custom_guardrail_recursion.py	fix: recursive pydantic issue (#19531)	2026-01-22 19:56:41 -08:00
test_custom_prompt_management.py	[Fix] CI/CD - Fix failing proxy and core integration tests (#17926)	2025-12-13 10:11:01 -08:00
test_deepeval.py	fix: use fastuuid helper (#14903)	2025-09-25 15:47:01 -07:00
test_galileo.py	feat(galileo): add health check support for UI callback test (#29908)	2026-06-08 13:57:03 -07:00
test_guardrail_logging_sync.py	feat(guardrails): add headroom guardrail for message compression (#31407)	2026-06-26 19:36:44 -07:00
test_langfuse.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_langfuse_otel.py	fix(langfuse): send v4 ingestion header for otel callback (#33907)	2026-07-18 20:36:51 -07:00
test_langsmith_init.py	Remove unneeded metadata info from LangSmith	2026-05-01 15:42:12 -07:00
test_mlflow.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_openmeter.py	Litellm oss staging 050626 (#29774)	2026-06-05 13:51:51 -07:00
test_opentelemetry.py	fix(otel): hashable scope for _emit_once when guardrail_mode is list (#31262)	2026-06-25 11:59:35 -07:00
test_opentelemetry_dynamic_imports.py	Make grpc dependency optional (#19447)	2026-01-20 19:03:52 -08:00
test_opik_utils.py	chore(ci): merge oss branch (#33784)	2026-07-17 23:22:13 +00:00
test_otel_guardrail_violation_spans.py	feat: add guardrail violation span attributes and fix missing spans on pre-call blocks (#28364)	2026-05-21 15:49:42 -07:00
test_otel_team_attributes_matrix.py	feat: propagate team_id and team_alias to all child OTEL spans (#28273)	2026-05-19 15:31:25 -07:00
test_prometheus_api_promql_escape.py	fix(prometheus): quote api_key for PromQL string literal in spend lookup	2026-05-01 21:38:19 +00:00
test_prometheus_budget_metric_guard.py	fix(prometheus): skip budget metric DB lookups when gauges are NoOpMetric (#32834)	2026-07-10 20:25:47 -07:00
test_prometheus_budget_metrics_db_lookups.py	perf(auth): negative-cache missing user/key lookups on the request hot path (#32368)	2026-07-08 09:59:57 +03:00
test_prometheus_budget_metrics_timeout.py	feat: litellm oss staging (#31935)	2026-07-03 09:27:31 +05:30
test_prometheus_cache_metrics.py	Litellm OSS Staging 010626 (#29422)	2026-06-01 21:42:51 -07:00
test_prometheus_client_ip_user_agent.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_custom_metadata_label_counts.py	Fix Prometheus remaining metric zero values (#27348)	2026-05-06 17:22:20 -07:00
test_prometheus_end_user_cardinality.py	perf: cap Prometheus end-user metric cardinality with TTL + LRU eviction (#27272)	2026-05-06 13:35:13 -07:00
test_prometheus_invalid_key_filtering.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_labels.py	feat(prometheus): add api_provider label to token, latency, request and cache metrics (#32126)	2026-07-04 15:16:08 -07:00
test_prometheus_mcp_tool_metrics.py	feat(prometheus): expose MCP tool metadata in Prometheus metrics (#31899)	2026-07-02 10:56:35 +03:00
test_prometheus_media_generation_metrics.py	feat(prometheus): expose video duration and image count consumption metrics (#33138)	2026-07-13 18:51:13 -07:00
test_prometheus_metric_name_consistency.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_missing_metrics.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_none_metadata.py	fix: guard against None metadata in prometheus metrics (#21489)	2026-02-18 12:40:45 -08:00
test_prometheus_overhead_with_guardrails.py	feat(prometheus): add litellm_total_overhead_latency_metric (SDK overhead + guardrails) (#31593)	2026-06-30 17:34:17 +08:00
test_prometheus_queue_guardrail_metrics.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_rate_limit_labels.py	fix(prometheus): read v3 rate limiter remaining values for per-key model gauges (#33119)	2026-07-13 14:27:56 -07:00
test_prometheus_remaining_tokens_router_fallback.py	fix(prometheus): emit litellm_remaining_tokens_metric for Bedrock and Vertex (#27705)	2026-05-13 17:40:59 -07:00
test_prometheus_services.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_spend_logs_metadata.py	fix(prometheus): expose project_alias in custom metadata labels (LIT-3741) (#31784)	2026-07-01 10:44:02 +08:00
test_prometheus_stream_label.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_token_detail_metrics.py	feat(prometheus): emit per-token-type detail metrics (LIT-3220) (#28372) (#28378)	2026-05-23 12:17:42 -07:00
test_prometheus_user_team_metrics.py	fix(proxy): count only active users toward license seat limit (#31227)	2026-06-29 18:01:02 -07:00
test_prompt_manager_ssti.py	fix(security): sandbox jinja2 in gitlab/arize/bitbucket prompt managers	2026-05-02 09:14:02 +00:00
test_responses_background_cost.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_rubrik.py	Litellm oss staging 04 21 2026 2 (#26569)	2026-05-20 21:25:19 -07:00
test_s3_v2.py	fix(s3): sanitize slashes in response-id-derived object key file name (#33271)	2026-07-14 17:26:00 -07:00
test_weave_otel.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00