FERNANDO IZAR c833b0c362 fix(prometheus): bound per-request budget metric emission with a timeout (#31632) ... * fix(prometheus): bound per-request budget metric emission with a timeout Wrap the per-request budget-metric gather in asyncio.wait_for so a slow Redis or DB lookup cannot consume the whole LoggingWorker watchdog and get the success-logging event cancelled. On timeout the emission is skipped in isolation; budget gauges are still refreshed by the periodic cron. The timeout is configurable via PROMETHEUS_BUDGET_METRICS_PER_REQUEST_TIMEOUT and defaults to 5.0 seconds, falling back to the default on an invalid value instead of raising * fix(prometheus): reject non-finite and non-positive budget-metrics timeout env float() accepts 0, negatives, nan and inf, which bypass the fallback: a value <= 0 makes asyncio.wait_for time out immediately and skip every per-request emission, and inf reintroduces the unbounded wait the timeout was meant to bound. Validate the parsed value is finite and greater than zero before using it, otherwise fall back to the default		2026-07-02 21:22:15 +05:30
..
arize	feat(arize/phoenix): OpenInference rendering parity — tool_calls, cost, passthrough I/O, session/user, multimodal, cache tokens (#28800)	2026-06-03 12:09:50 -07:00
azure_storage	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
bitbucket	fix: block path traversal SSRF in BitBucket, Arize Phoenix, and AssemblyAI clients (#26943)	2026-05-01 11:45:12 -07:00
cloudzero	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
code_interpreter_interception	feat(sandbox): reuse e2b container across requests when metadata.session_id is set (#31688)	2026-06-30 18:58:09 -07:00
compression_interception	fix(callbacks): forward callback_settings to callback initializers and guard consumers against non-dict values (#30161)	2026-06-10 15:22:00 -07:00
datadog	chore(oss): litellm oss staging 120626 (#30292)	2026-06-12 09:49:25 -07:00
dotprompt	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
focus	chore: litellm oss staging (#31185)	2026-06-26 09:17:44 -07:00
gcs_bucket	fix cloud storage file guards	2026-05-01 15:34:11 -07:00
gcs_pubsub	Litellm fix GitHub action testing (#11163)	2025-05-26 14:41:42 -07:00
gitlab	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
langfuse	Litellm oss staging 050626 (#29774)	2026-06-05 13:51:51 -07:00
levo	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
litellm_agent	Agent Builder - support new experimental agent builder, to ensure agents pass compliance checks (#21817)	2026-02-21 15:32:47 -08:00
mavvrik_focus	chore: litellm oss staging (#31185)	2026-06-26 09:17:44 -07:00
newrelic	feat: litellm oss 110626 (#30202)	2026-06-11 22:30:26 -07:00
open_telemetry	fix(otel): capture 401 error details in management endpoint spans (#29535)	2026-06-02 16:40:30 -07:00
opik	Litellm oss staging 030626 (#29578)	2026-06-03 11:01:51 -07:00
otel	feat(otel): emit a tools/list CLIENT span for MCP discovery under otel_v2 (#31525)	2026-06-30 10:26:57 -07:00
SlackAlerting	chore(oss): litellm oss staging 120626 (#30292)	2026-06-12 09:49:25 -07:00
websearch_interception	fix(websearch): websearch_interception agentic loop fixes for chat completions and anthropic messages (#31669)	2026-07-01 09:36:40 +08:00
rubrik_test_helpers.py	Litellm oss staging 04 21 2026 2 (#26569)	2026-05-20 21:25:19 -07:00
test_agentops.py	Litellm fix GitHub action testing (#11163)	2025-05-26 14:41:42 -07:00
test_anthropic_cache_control_hook.py	feat: add cache control injection support for v1/messages endpoint (#31778)	2026-06-30 19:31:51 -07:00
test_athina.py	Litellm fix GitHub action testing (#11163)	2025-05-26 14:41:42 -07:00
test_azure_sentinel.py	Add Azure Sentinel audit log support (#27280)	2026-05-06 15:50:06 -07:00
test_braintrust_logging.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_braintrust_span_name.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_custom_guardrail.py	chore(oss): litellm oss staging 150626 (#30463)	2026-06-16 12:06:41 -07:00
test_custom_guardrail_recursion.py	fix: recursive pydantic issue (#19531)	2026-01-22 19:56:41 -08:00
test_custom_prompt_management.py	[Fix] CI/CD - Fix failing proxy and core integration tests (#17926)	2025-12-13 10:11:01 -08:00
test_deepeval.py	fix: use fastuuid helper (#14903)	2025-09-25 15:47:01 -07:00
test_galileo.py	feat(galileo): add health check support for UI callback test (#29908)	2026-06-08 13:57:03 -07:00
test_guardrail_logging_sync.py	feat(guardrails): add headroom guardrail for message compression (#31407)	2026-06-26 19:36:44 -07:00
test_langfuse.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_langfuse_otel.py	chore(oss): litellm oss staging 120626 (#30292)	2026-06-12 09:49:25 -07:00
test_langsmith_init.py	Remove unneeded metadata info from LangSmith	2026-05-01 15:42:12 -07:00
test_mlflow.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_openmeter.py	Litellm oss staging 050626 (#29774)	2026-06-05 13:51:51 -07:00
test_opentelemetry.py	fix(otel): hashable scope for _emit_once when guardrail_mode is list (#31262)	2026-06-25 11:59:35 -07:00
test_opentelemetry_dynamic_imports.py	Make grpc dependency optional (#19447)	2026-01-20 19:03:52 -08:00
test_otel_guardrail_violation_spans.py	feat: add guardrail violation span attributes and fix missing spans on pre-call blocks (#28364)	2026-05-21 15:49:42 -07:00
test_otel_team_attributes_matrix.py	feat: propagate team_id and team_alias to all child OTEL spans (#28273)	2026-05-19 15:31:25 -07:00
test_prometheus_api_promql_escape.py	fix(prometheus): quote api_key for PromQL string literal in spend lookup	2026-05-01 21:38:19 +00:00
test_prometheus_budget_metrics_timeout.py	fix(prometheus): bound per-request budget metric emission with a timeout (#31632)	2026-07-02 21:22:15 +05:30
test_prometheus_cache_metrics.py	Litellm OSS Staging 010626 (#29422)	2026-06-01 21:42:51 -07:00
test_prometheus_client_ip_user_agent.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_custom_metadata_label_counts.py	Fix Prometheus remaining metric zero values (#27348)	2026-05-06 17:22:20 -07:00
test_prometheus_end_user_cardinality.py	perf: cap Prometheus end-user metric cardinality with TTL + LRU eviction (#27272)	2026-05-06 13:35:13 -07:00
test_prometheus_invalid_key_filtering.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_labels.py	feat(prometheus): add requested_model label to spend and requests metrics (#31410)	2026-06-26 15:26:55 -07:00
test_prometheus_mcp_tool_metrics.py	feat(prometheus): expose MCP tool metadata in Prometheus metrics (#31899)	2026-07-02 10:56:35 +03:00
test_prometheus_metric_name_consistency.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_missing_metrics.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_none_metadata.py	fix: guard against None metadata in prometheus metrics (#21489)	2026-02-18 12:40:45 -08:00
test_prometheus_overhead_with_guardrails.py	feat(prometheus): add litellm_total_overhead_latency_metric (SDK overhead + guardrails) (#31593)	2026-06-30 17:34:17 +08:00
test_prometheus_queue_guardrail_metrics.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_rate_limit_labels.py	feat: standardize rate limit errors with category, rate_limit_type, model, and llm_provider fields (#27687)	2026-06-06 17:50:29 -07:00
test_prometheus_remaining_tokens_router_fallback.py	fix(prometheus): emit litellm_remaining_tokens_metric for Bedrock and Vertex (#27705)	2026-05-13 17:40:59 -07:00
test_prometheus_services.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_spend_logs_metadata.py	fix(prometheus): expose project_alias in custom metadata labels (LIT-3741) (#31784)	2026-07-01 10:44:02 +08:00
test_prometheus_stream_label.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_prometheus_token_detail_metrics.py	feat(prometheus): emit per-token-type detail metrics (LIT-3220) (#28372) (#28378)	2026-05-23 12:17:42 -07:00
test_prometheus_user_team_metrics.py	fix(proxy): count only active users toward license seat limit (#31227)	2026-06-29 18:01:02 -07:00
test_prompt_manager_ssti.py	fix(security): sandbox jinja2 in gitlab/arize/bitbucket prompt managers	2026-05-02 09:14:02 +00:00
test_responses_background_cost.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_rubrik.py	Litellm oss staging 04 21 2026 2 (#26569)	2026-05-20 21:25:19 -07:00
test_s3_v2.py	decouple S3 audit-log config via s3_audit_callback_params	2026-05-05 13:23:32 -07:00
test_weave_otel.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00