ryan-crabbe-berri 38f3f8a1a9 fix(proxy): cooldown errors carry 429, Sentry starts at boot without request bodies, tracing failures log at ERROR, exporter counters exported (#46344) ... * fix(router): carry a 429 status on cooldown and no-deployment errors RouterRateLimitError and RouterRateLimitErrorBasic had no status_code, so the proxy answered an all-deployments-cooled-down request as a generic 500 class error and logged the bug report notice for every cooldown. Both now carry status_code 429, which the proxy maps to a rate_limit_error and which the retry policy already treats as retryable * fix(proxy): start Sentry at config load and never attach request bodies Sentry only came up inside set_callbacks on the first LLM call, so boot and background errors were never reported, and general_settings.alerting: [sentry] always raised Missing SENTRY_DSN because the alerting path read a dead litellm.utils pin instead of the live SDK. The proxy now initializes Sentry once while loading the config whenever sentry is a configured callback or alerting target, the alerting and failure handlers read the live instance, and max_request_body_size is pinned to never so prompts and completions stay out of Sentry events * fix(tracing): log Lens failures at ERROR and export row counters to Prometheus A tracing store that fails to start, or a Lens service that rejects a batch, was only logged at WARNING, so operators running at the default ERROR level never saw tracing silently go dark. Both now log at ERROR and name the lens store. The exporter's rows_written and rows_dropped tallies were never exported, so the two counts are now Prometheus counters litellm_lens_export_rows_written_total and litellm_lens_export_rows_dropped_total, registered lazily on the default registry like the other proxy-level counters and charted on the all-metrics Grafana dashboard * test(proxy): drop the litellm import the alerting tests no longer use * fix(proxy): start Sentry once a DSN is set, from any config source Boot-time init used to lock Sentry in even with no SENTRY_DSN, so a DSN loaded later from DB environment_variables was never picked up. initialize_sentry now skips when no DSN is set and re-inits when the DSN changes. alerting_handler calls it too, so alerting: [sentry] set through the DB works. Drops the litellm_settings.callbacks check since that config fails to load with sentry in it * fix(sentry): keep stack frame locals out of events unless PII is opted in Frame locals carried prompts (messages, request bodies, provider options) into every error event. include_local_variables now follows SENTRY_SEND_DEFAULT_PII * test(router): drop the test that only pinned the 429 class attribute * fix(proxy): start Sentry at boot when it is only an input callback * fix(proxy): keep Sentry init and alerting within the strict ruff and basedpyright ceilings --------- Co-authored-by: yuneng-jiang <yuneng@berri.ai>		2026-10-16 00:53:52 +00:00
..
arize	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
azure_storage	feat(azure_storage): upload audit logs to Azure Storage via audit_log_callbacks (#43838)	2026-10-10 14:48:56 -07:00
bitbucket	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
clickhouse	fix(proxy): honor disable_end_user_cost_tracking in spend logs and end-user tables (#40945)	2026-10-15 21:48:20 +00:00
cloudzero	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
code_interpreter_interception	fix(websearch_interception): drop stream_options when forcing stream=False and replay it on the final stream (#45433)	2026-10-09 22:16:02 -07:00
compression_interception	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
datadog	test(unit): wait on the work itself instead of fixed sleeps (#46261)	2026-10-13 12:41:06 -07:00
dotprompt	test: finish the non-proxy half of tests/test_litellm (#43281)	2026-09-25 22:43:41 -07:00
focus	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
gcs_bucket	fix(ollama): prevent reused response ids from dropping spend logs (#39227)	2026-10-15 17:17:51 -07:00
gcs_pubsub	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
generic_api	fix: cap cold MCP schema workers at usable CPUs and deflake wall-clock unit tests (#45791)	2026-10-15 00:47:59 -07:00
gitlab	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
helicone	test: add __init__.py to migrated tests/unit packages	2026-09-20 11:53:49 +00:00
langfuse	fix: cap cold MCP schema workers at usable CPUs and deflake wall-clock unit tests (#45791)	2026-10-15 00:47:59 -07:00
levo	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
litellm_agent	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
mavvrik_focus	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
newrelic	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
open_telemetry	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
opik	test(unit): wait on the work itself instead of fixed sleeps (#46261)	2026-10-13 12:41:06 -07:00
otel	feat(proxy): return the W3C traceresponse header on traced responses (#42079)	2026-10-14 18:12:34 -07:00
pointfive	chore(lint): remove the LIT002 mutable-construction rule (#43971)	2026-10-01 12:24:02 -07:00
SlackAlerting	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
ternary	feat(focus): add ternary destination for FOCUS export (#46106)	2026-10-12 22:52:40 -07:00
vantage	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
vector_store_integrations	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
websearch_interception	fix(websearch_interception): intercept the bare web_search tool type on chat completions (#46736)	2026-10-15 14:08:51 -07:00
zerobus	test(zerobus): move tests into active CI selection (#43235)	2026-09-25 23:35:15 +00:00
__init__.py	test: add __init__.py to migrated tests/unit packages	2026-09-20 11:53:49 +00:00
conftest.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
rubrik_test_helpers.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_adaptive_concurrency.py	fix(s3_v2): upload fresh events first, drop terminal failures and hour-old retries by default, opt-in adaptive concurrency (#43022)	2026-09-26 14:58:28 -07:00
test_agentops.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_anthropic_cache_control_hook.py	fix(anthropic): count a replayed server tool call's cache mark the way modify_params sends it (#46591)	2026-10-15 14:46:43 -07:00
test_argilla.py	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
test_athina.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_azure_sentinel.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_braintrust_logging.py	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
test_braintrust_span_name.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_custom_callback_input.py	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
test_custom_guardrail.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_custom_guardrail_recursion.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_custom_logger.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_custom_prompt_management.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_deepeval.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_galileo.py	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
test_guardrail_logging_sync.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_helicone.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_humanloop.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_langfuse.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_langfuse_otel.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_langsmith.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_langsmith_init.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_lunary.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_mlflow.py	test(unit): wait on the work itself instead of fixed sleeps (#46261)	2026-10-13 12:41:06 -07:00
test_openmeter.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_opentelemetry.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_opentelemetry_dynamic_imports.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_opentelemetry_request_spans.py	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
test_opik_utils.py	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
test_otel_guardrail_violation_spans.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_otel_team_attributes_matrix.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_posthog.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_prometheus_api_promql_escape.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_budget_metric_guard.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_budget_metrics_db_lookups.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_budget_metrics_timeout.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_cache_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_caller_identity.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_carried_budget_state.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_client_ip_user_agent.py	feat(prometheus): expose per-project per-model rate limit allowed and used gauges (#43561)	2026-10-08 12:03:29 -05:00
test_prometheus_custom_metadata_label_counts.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_deployment_state_proxy_rejects.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_end_user_cardinality.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_input_sequence_length_label.py	feat(ui): add auto-router usage and savings table (#45152)	2026-10-07 15:04:07 -07:00
test_prometheus_invalid_key_filtering.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_labels.py	fix(prometheus): add model_group label to end-to-end latency metrics (#44860)	2026-10-07 11:18:45 -07:00
test_prometheus_mcp_tool_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_media_generation_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_metric_name_consistency.py	fix(proxy): cooldown errors carry 429, Sentry starts at boot without request bodies, tracing failures log at ERROR, exporter counters exported (#46344)	2026-10-16 00:53:52 +00:00
test_prometheus_metrics_endpoint.py	test(unit): wait on the work itself instead of fixed sleeps (#46261)	2026-10-13 12:41:06 -07:00
test_prometheus_missing_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_none_metadata.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_overhead_with_guardrails.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_queue_guardrail_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_rate_limit_labels.py	fix(prometheus): skip custom metadata labels a metric already carries (#46267)	2026-10-13 18:20:52 -07:00
test_prometheus_remaining_tokens_router_fallback.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_requested_model_cardinality.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_series_cardinality.py	feat(prometheus): cap series per metric for every labeled metric (#44420)	2026-10-06 01:28:44 +00:00
test_prometheus_service_tier_label.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_services.py	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
test_prometheus_spend_capture_rate.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_spend_logs_metadata.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_stream_label.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_token_detail_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_user_team_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_zero_cost_metric.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prompt_manager_ssti.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_responses_background_cost.py	fix(responses): bill a background response once, on the first read or poll that sees it finished (#45703)	2026-10-15 11:00:14 -07:00
test_rubrik.py	feat(guardrails): honor litellm_params.timeout in every HTTP guardrail (#43134)	2026-09-30 21:18:47 -07:00
test_s3.py	feat(s3_v2): add s3_partition_granularity option for hourly S3 folders (#43748)	2026-10-01 11:00:21 -07:00
test_s3_v2.py	fix(s3): bound object key filenames (#40825)	2026-10-15 12:59:35 -07:00
test_shadow_eval_logger.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_sqs.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_wandb.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_weave_otel.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00