Kerry Lu e6a32bbeeb fix(proxy): buffer tool discoveries in Redis and write LiteLLM_ToolTable in one statement per drain, on its own lock (#48089) ... * fix(proxy): buffer tool discoveries in redis and let the leader write LiteLLM_ToolTable in one statement Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): declare the redis family on the tool discovery buffer and drop the blind except and cast Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): satisfy LIT010 and LIT014 in the tool discovery buffer Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): mark the aggregation fold Final Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): requeue drained tool rows to redis when the write provably did not apply Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): drain tool discoveries on their own lock and scheduler job, not the spend commit * chore(proxy): suppress the untyped apscheduler add_job on the tool discovery job * refactor(proxy): move the LiteLLM_ToolTable bulk upsert into its own module next to the other bulk upserts Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): name the LiteLLM_ToolTable bulk write span so the prisma span check resolves it * refactor(proxy): move the tool discovery drain out of DBSpendUpdateWriter into tool_registry_writer * refactor(proxy): share db_write_failure_is_requeue_safe from exception_handler so the spend writer stays untouched --------- Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com>		2026-10-24 12:34:13 -07:00
..
db_transaction_queue	fix(proxy): buffer tool discoveries in Redis and write LiteLLM_ToolTable in one statement per drain, on its own lock (#48089)	2026-10-24 12:34:13 -07:00
mcp_server	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
__init__.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
conftest.py	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
fake_prisma_engine.py	fix(otel): name postgres service spans by operation and table (#44240)	2026-10-03 09:20:28 -07:00
test_autorouter_session_rollup.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_budget_window_spend_writer.py	fix(otel): name postgres service spans by operation and table (#44240)	2026-10-03 09:20:28 -07:00
test_check_migration.py	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
test_create_views.py	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
test_daily_spend_bulk_upsert.py	fix(proxy): bound daily spend rollup row-lock waits with lock_timeout and requeue 55P03 (#44450)	2026-10-06 17:38:55 -05:00
test_db_lookup_gate.py	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
test_db_span.py	fix(otel): name postgres service spans by operation and table (#44240)	2026-10-03 09:20:28 -07:00
test_db_spend_update_writer.py	fix(proxy): buffer tool discoveries in Redis and write LiteLLM_ToolTable in one statement per drain, on its own lock (#48089)	2026-10-24 12:34:13 -07:00
test_db_url_settings.py	fix(proxy): sign RDS IAM tokens for the database's own region (#44782)	2026-10-09 15:41:07 -07:00
test_exception_handler.py	fix(proxy): bound daily spend rollup row-lock waits with lock_timeout and requeue 55P03 (#44450)	2026-10-06 17:38:55 -05:00
test_exception_handler_reconnect_retry.py	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
test_gateway_request_tracking.py	feat(proxy): track failed requests by HTTP status and caller (#45244)	2026-10-09 14:27:56 -07:00
test_health_check_latest.py	fix(proxy): show the newest health check per model group on the model hub (#47552)	2026-10-20 16:42:53 -07:00
test_log_db_metrics.py	fix(proxy): keep the database error when the log_db_metrics failure hook raises (#44383)	2026-10-03 16:38:15 +00:00
test_log_db_metrics_service_spans.py	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
test_master_key_migration.py	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
test_model_access_group_spend.py	fix(proxy): bound daily spend rollup row-lock waits with lock_timeout and requeue 55P03 (#44450)	2026-10-06 17:38:55 -05:00
test_model_insights_tasks.py	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
test_model_usage_rollup.py	fix(responses): bill a background response once, on the first read or poll that sees it finished (#45703)	2026-10-15 11:00:14 -07:00
test_object_permission_repository.py	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
test_pgbouncer.py	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
test_prisma_client.py	fix(proxy): unset DB environment variables removed from the row on every worker by row revision (#46709)	2026-10-17 03:51:05 +00:00
test_prisma_planned_engine_restart.py	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
test_prisma_query_span.py	feat(lens): isolate ingestion and investigations in a Rust service (#45148)	2026-10-07 17:18:58 -07:00
test_prisma_self_heal.py	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
test_proxy_worker_heartbeat.py	fix(otel): name postgres service spans by operation and table (#44240)	2026-10-03 09:20:28 -07:00
test_query_engine_reaper.py	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
test_rds_iam_token_expiry.py	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
test_replica_identity.py	test: migrate proxy security, schema migration and MCP legacy tests (#45937)	2026-10-11 16:17:24 -07:00
test_request_error_tracking.py	feat(proxy): track failed requests by HTTP status and caller (#45244)	2026-10-09 14:27:56 -07:00
test_routing_prisma_wrapper.py	fix(proxy): sign RDS IAM tokens for the database's own region (#44782)	2026-10-09 15:41:07 -07:00
test_shadow_eval_funnel.py	fix(otel): name postgres service spans by operation and table (#44240)	2026-10-03 09:20:28 -07:00
test_spend_counter_reseed.py	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
test_spend_log_batching.py	test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy (#44012)	2026-10-01 18:14:24 +00:00
test_spend_log_tool_index.py	fix(responses): log and bill every round of non-stream MCP auto-execute (#43667)	2026-10-16 17:37:33 +00:00
test_token_auth.py	fix(proxy): sign RDS IAM tokens for the database's own region (#44782)	2026-10-09 15:41:07 -07:00
test_tool_registry_writer.py	fix(proxy): buffer tool discoveries in Redis and write LiteLLM_ToolTable in one statement per drain, on its own lock (#48089)	2026-10-24 12:34:13 -07:00
test_tool_table_bulk_upsert.py	fix(proxy): buffer tool discoveries in Redis and write LiteLLM_ToolTable in one statement per drain, on its own lock (#48089)	2026-10-24 12:34:13 -07:00
test_update_daily_tag_spend.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00