devin-ai-integration[bot] b55024658c fix(proxy)!: stop update_cache from resurrecting evicted auth cache entries (#46997) ... * fix(proxy): stop update_cache from resurrecting evicted auth cache entries Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(proxy): update update_cache pins for synchronous write-back Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(proxy): wrap long assert in update_cache tag test Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(proxy): cover refill race and pin TTL with injected clock Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): count global proxy spend for every request with a user, cached on this worker or not * fix(proxy): add global proxy spend with an atomic Redis increment that never re-creates a reset counter The global proxy spend bump read the total, awaited, and wrote old + cost back from a background task, so a budget reset that deleted the key in between got the pre-reset total written back, and workers overwrote each other's totals. RedisCache.async_increment_if_present runs INCRBYFLOAT only when the key exists, keeping its TTL, and this worker's copy is then set from the shared total with no await between its read and write. The bump now runs whenever a proxy max_budget is set, matching the DB writer, and the armed post-call read and the batch-read declaration it used are removed. * fix(proxy): report the global spend Redis increment to service metrics and request traces The global proxy spend increment now emits Redis service success and failure events under the spend_counters target and passes the request span through, so it shows as redis.incr spend_counters like the write it replaced. The unit tests run the real RedisCache increment against fakeredis instead of mocks, and a new test checks the span lands under the request span on success and on a Redis failure. * test(proxy): keep the spend counter Redis fake off the network * test(proxy): count increment_if_present as a shared-cache call in the key-family guard * fix(proxy): keep the newer global spend total when Redis replies arrive out of order --------- Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>		2026-10-20 17:09:53 +00:00
..
arize	fix(otel)!: leave out span cost when the price lookup failed (#44187)	2026-10-20 09:48:47 +00:00
azure_storage	feat(azure_storage): upload audit logs to Azure Storage via audit_log_callbacks (#43838)	2026-10-10 14:48:56 -07:00
bitbucket	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
clickhouse	fix(proxy): honor disable_end_user_cost_tracking in spend logs and end-user tables (#40945)	2026-10-15 21:48:20 +00:00
cloudzero	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
code_interpreter_interception	fix(websearch_interception): drop stream_options when forcing stream=False and replay it on the final stream (#45433)	2026-10-09 22:16:02 -07:00
compression_interception	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
datadog	test(unit): wait on the work itself instead of fixed sleeps (#46261)	2026-10-13 12:41:06 -07:00
dotprompt	test: finish the non-proxy half of tests/test_litellm (#43281)	2026-09-25 22:43:41 -07:00
focus	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
gcs_bucket	fix(ollama): prevent reused response ids from dropping spend logs (#39227)	2026-10-15 17:17:51 -07:00
gcs_pubsub	feat(router): keep a session on one kubernetes pod (#44393)	2026-10-19 09:58:19 -07:00
generic_api	fix: cap cold MCP schema workers at usable CPUs and deflake wall-clock unit tests (#45791)	2026-10-15 00:47:59 -07:00
gitlab	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
helicone	test: add __init__.py to migrated tests/unit packages	2026-09-20 11:53:49 +00:00
langfuse	fix: cap cold MCP schema workers at usable CPUs and deflake wall-clock unit tests (#45791)	2026-10-15 00:47:59 -07:00
levo	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
litellm_agent	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
mavvrik_focus	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
newrelic	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
open_telemetry	fix(otel): put the error message on every failed span status (#44185)	2026-10-20 06:35:47 +00:00
opik	test(unit): wait on the work itself instead of fixed sleeps (#46261)	2026-10-13 12:41:06 -07:00
otel	fix(proxy)!: stop update_cache from resurrecting evicted auth cache entries (#46997)	2026-10-20 17:09:53 +00:00
pointfive	chore(lint): remove the LIT002 mutable-construction rule (#43971)	2026-10-01 12:24:02 -07:00
SlackAlerting	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
ternary	feat(focus): add ternary destination for FOCUS export (#46106)	2026-10-12 22:52:40 -07:00
vantage	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
vector_store_integrations	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
websearch_interception	fix(exa): return highlights, highlight scores, score and the response envelope from Exa search (#47423)	2026-10-19 15:45:56 -07:00
zerobus	test(zerobus): move tests into active CI selection (#43235)	2026-09-25 23:35:15 +00:00
__init__.py	test: add __init__.py to migrated tests/unit packages	2026-09-20 11:53:49 +00:00
conftest.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
rubrik_test_helpers.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_adaptive_concurrency.py	fix(s3_v2): upload fresh events first, drop terminal failures and hour-old retries by default, opt-in adaptive concurrency (#43022)	2026-09-26 14:58:28 -07:00
test_agentops.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_anthropic_cache_control_hook.py	fix(anthropic, bedrock)!: keep a redacted_thinking content item on every Claude route (#47489)	2026-10-20 15:00:31 +00:00
test_argilla.py	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
test_athina.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_azure_sentinel.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_braintrust_logging.py	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
test_braintrust_span_name.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_custom_callback_input.py	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
test_custom_guardrail.py	fix(guardrails): record every content filter match in logging_only and offer the mode in the UI (#46673)	2026-10-16 00:37:03 -07:00
test_custom_guardrail_recursion.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_custom_logger.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_custom_prompt_management.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_deepeval.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_galileo.py	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
test_guardrail_logging_sync.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_helicone.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_humanloop.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_langfuse.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_langfuse_otel.py	fix(langfuse_otel)!: send the completion start time (#45597)	2026-10-20 13:52:26 +00:00
test_langsmith.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_langsmith_init.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_lunary.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_mlflow.py	test(unit): wait on the work itself instead of fixed sleeps (#46261)	2026-10-13 12:41:06 -07:00
test_openmeter.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_opentelemetry.py	fix(otel): put the error message on every failed span status (#44185)	2026-10-20 06:35:47 +00:00
test_opentelemetry_dynamic_imports.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_opentelemetry_request_spans.py	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
test_opik_utils.py	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
test_otel_guardrail_violation_spans.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_otel_team_attributes_matrix.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_posthog.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_prometheus_api_promql_escape.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_budget_metric_guard.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_budget_metrics_db_lookups.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_budget_metrics_timeout.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_cache_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_caller_identity.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_carried_budget_state.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_client_ip_user_agent.py	feat(prometheus): expose per-project per-model rate limit allowed and used gauges (#43561)	2026-10-08 12:03:29 -05:00
test_prometheus_custom_metadata_label_counts.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_deployment_state_proxy_rejects.py	fix(proxy)!: answer 400 for malformed tools on count_tokens instead of crashing (#46583)	2026-10-16 14:57:53 -07:00
test_prometheus_end_user_cardinality.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_input_sequence_length_label.py	feat(ui): add auto-router usage and savings table (#45152)	2026-10-07 15:04:07 -07:00
test_prometheus_invalid_key_filtering.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_labels.py	fix(prometheus): preserve requested model after fallback (#45555)	2026-10-19 23:41:41 -07:00
test_prometheus_mcp_tool_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_media_generation_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_metric_name_consistency.py	fix(proxy): cooldown errors carry 429, Sentry starts at boot without request bodies, tracing failures log at ERROR, exporter counters exported (#46344)	2026-10-16 00:53:52 +00:00
test_prometheus_metrics_endpoint.py	test(unit): wait on the work itself instead of fixed sleeps (#46261)	2026-10-13 12:41:06 -07:00
test_prometheus_missing_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_none_metadata.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_overhead_with_guardrails.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_queue_guardrail_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_rate_limit_labels.py	fix(prometheus): skip custom metadata labels a metric already carries (#46267)	2026-10-13 18:20:52 -07:00
test_prometheus_remaining_tokens_router_fallback.py	fix(prometheus): set the remaining rate-limit gauges from decimal headers again (#47039)	2026-10-17 05:20:00 +00:00
test_prometheus_requested_model_cardinality.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_series_cardinality.py	feat(prometheus): cap series per metric for every labeled metric (#44420)	2026-10-06 01:28:44 +00:00
test_prometheus_service_tier_label.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_services.py	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
test_prometheus_spend_capture_rate.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_spend_logs_metadata.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_stream_label.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_token_detail_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_user_team_metrics.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prometheus_zero_cost_metric.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_prompt_manager_ssti.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00
test_responses_background_cost.py	fix(responses): bill a background response once, on the first read or poll that sees it finished (#45703)	2026-10-15 11:00:14 -07:00
test_rubrik.py	feat(guardrails): honor litellm_params.timeout in every HTTP guardrail (#43134)	2026-09-30 21:18:47 -07:00
test_s3.py	feat(s3_v2): add s3_partition_granularity option for hourly S3 folders (#43748)	2026-10-01 11:00:21 -07:00
test_s3_v2.py	fix(s3): bound object key filenames (#40825)	2026-10-15 12:59:35 -07:00
test_shadow_eval_logger.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_sqs.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_wandb.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_weave_otel.py	test: move tests/test_litellm integrations and secret_managers into tests/unit (#43194)	2026-09-25 12:57:07 -07:00