Etienne Chabert 372c096388 fix(proxy): evict a deleted key from every worker's auth cache (#47609) ... * fix(proxy): evict a deleted key from every worker's auth cache /key/delete dropped the key object only from the in-memory cache of the worker that served the call. Auth serves key objects cache-first, so every other worker, and the Redis copy when enable_redis_auth_cache is on, kept authenticating the deleted key until user_api_key_cache_ttl expired. /key/update already evicts and broadcasts through evict_and_broadcast, delete now does the same for the tokens it deletes * fix(proxy): evict only the deleted rows and broadcast them in one batch Scope the cross-worker eviction on /key/delete to the rows the caller was allowed to delete and send it through delete_cache_key_objects, so a caller-supplied name can no longer drop another team's cached entries on every worker * refactor(proxy): drop the comment above the delete eviction call * fix(proxy): run the usage cache eviction beside the auth eviction so a hung Redis costs one wait * test(proxy): wait on the broadcast instead of a sleep and type the peer eviction tests * test(proxy): wait for the peer to apply the broadcast instead of polling its cache * test(proxy): cover hashed keys and aliases when deleting a key warmed on a peer * fix(key_management): evict every requested key on delete, including keys whose row is already gone A batch delete that names a live key and a key whose row was removed outside the API evicted only the live key, so the gone key kept authenticating from every worker's cache. Every requested key hash is evicted now, while raw non-key cache keys are still left alone * test(key_management): split the gone-row eviction assertion into one comprehension per worker --------- Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>		2026-10-30 10:20:00 -07:00
..
management_v1	feat(ui): sort budgets by reset duration (#48107)	2026-10-23 16:21:53 -07:00
policy_endpoints	refactor(types): replace Any with proven types in 14 files (#48928)	2026-10-29 07:26:07 -07:00
scim	fix(sso): keep CLI SSO and Claude Code gateway team lists in the user record's order (#49033)	2026-10-30 05:07:00 -07:00
search_endpoints	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
sso	fix(proxy): route SSO token exchange and userinfo calls through litellm's httpx client (#46547)	2026-10-15 15:14:25 -07:00
usage_endpoints	feat(ui): unify gateway and usage assistance as Aria Agent (#48082)	2026-10-23 20:24:19 +00:00
__init__.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
jwt_key_mapping_doubles.py	test(proxy): move management_endpoints, management_helpers and guardrails tests into tests/unit/proxy (#44003)	2026-10-01 10:52:03 -07:00
test_access_group_endpoints.py	feat(access-groups): grant Claude Code skills through access groups (#46294)	2026-10-14 23:18:50 +00:00
test_access_group_management.py	fix(proxy): apply new model rows on every worker as soon as they are written (#49034)	2026-10-30 03:19:25 -07:00
test_activity_tenant_scoping.py	feat(proxy): bounded daily activity routes for all usage entities (#43408)	2026-10-01 16:57:23 -07:00
test_auto_router_endpoints.py	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
test_budget_endpoints.py	feat(proxy): per-model team member budgets with router fallback (#43887)	2026-10-10 20:33:55 +00:00
test_cache_settings_endpoints.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_callback_management_endpoints.py	feat(otel): let team and key Arize callbacks choose the OTLP transport (#44492)	2026-10-06 14:46:50 -05:00
test_common_daily_activity.py	feat(usage): show subscription-covered providers and account fees separately (#44772)	2026-10-30 03:58:36 -07:00
test_common_utils.py	feat(proxy): per-model team member budgets with router fallback (#43887)	2026-10-10 20:33:55 +00:00
test_compliance_endpoints.py	test(proxy): move management_endpoints, management_helpers and guardrails tests into tests/unit/proxy (#44003)	2026-10-01 10:52:03 -07:00
test_config_override_endpoints.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_coordination_redis_endpoints.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_cost_estimate_endpoint.py	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
test_cost_tracking_settings.py	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
test_credential_migration.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_customer_budget.py	test(proxy): move management_endpoints, management_helpers and guardrails tests into tests/unit/proxy (#44003)	2026-10-01 10:52:03 -07:00
test_customer_endpoints.py	fix(proxy)!: paginate customer lists and usage filters (#48700)	2026-10-27 19:46:06 -07:00
test_daily_activity_routes.py	fix!: retain unattributed daily activity across reports and exports (#48925)	2026-10-29 09:39:49 -07:00
test_delete_callbacks_endpoint.py	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
test_delete_verification_tokens_failed.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_encryption_endpoints.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_entraid_app_roles.py	test(proxy): move management_endpoints, management_helpers and guardrails tests into tests/unit/proxy (#44003)	2026-10-01 10:52:03 -07:00
test_gateway_request_endpoints.py	feat(proxy): track failed requests by HTTP status and caller (#45244)	2026-10-09 14:27:56 -07:00
test_id_jag_assertion_capture.py	feat(sso): retain the SAML assertion at login as the saml2 subject token for oauth2_id_jag (#46745)	2026-10-16 12:16:56 -07:00
test_internal_user_endpoints.py	fix(sso): keep CLI SSO and Claude Code gateway team lists in the user record's order (#49033)	2026-10-30 05:07:00 -07:00
test_jwt_key_mapping.py	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
test_key_budget_change.py	fix(proxy)!: gate key budget_duration and budget_id updates like max_budget (#47681)	2026-10-26 16:45:35 -07:00
test_key_generate_prisma.py	fix(auth): return a generic 401 for an unknown key (#39787)	2026-10-15 01:05:25 -07:00
test_key_management_endpoints.py	fix(proxy): evict a deleted key from every worker's auth cache (#47609)	2026-10-30 10:20:00 -07:00
test_management_route_coverage.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_mcp_connector_import.py	feat(mcp)!: disable stdio MCP servers by default (#44066)	2026-10-02 10:28:04 -07:00
test_mcp_management_endpoints.py	refactor(mcp): drop the experimental label from the MCP server and client paths (#48513)	2026-10-27 17:47:50 +00:00
test_mcp_servers.py	refactor(mcp): drop the experimental label from the MCP server and client paths (#48513)	2026-10-27 17:47:50 +00:00
test_model_insights_endpoints.py	fix(proxy): bound daily spend rollup row-lock waits with lock_timeout and requeue 55P03 (#44450)	2026-10-06 17:38:55 -05:00
test_model_management_endpoints.py	fix(proxy): apply new model rows on every worker as soon as they are written (#49034)	2026-10-30 03:19:25 -07:00
test_org_admin_team_access.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_organization_endpoints.py	fix(proxy)!: stop labelling management and health rejections as auth failures (#48739)	2026-10-28 21:49:03 -07:00
test_password_endpoints.py	test(proxy): move management_endpoints, management_helpers and guardrails tests into tests/unit/proxy (#44003)	2026-10-01 10:52:03 -07:00
test_policy_endpoints.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_project_org_authz.py	test(proxy): move management_endpoints, management_helpers and guardrails tests into tests/unit/proxy (#44003)	2026-10-01 10:52:03 -07:00
test_prompt_cache_prediction.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_prompt_caching_requests.py	test(proxy): move management_endpoints, management_helpers and guardrails tests into tests/unit/proxy (#44003)	2026-10-01 10:52:03 -07:00
test_ptu_consumption.py	fix(router): serve a team's wildcard deployment before a proxy-wide wildcard (#48490)	2026-10-26 17:06:09 -07:00
test_ptu_model_settings.py	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
test_request_error_endpoints.py	feat(proxy): track failed requests by HTTP status and caller (#45244)	2026-10-09 14:27:56 -07:00
test_roi_calculator_endpoints.py	feat(roi): measure shipping velocity, quality, and recorded spend (#44426)	2026-10-03 23:07:34 +00:00
test_router_settings_endpoints.py	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
test_saml_sso.py	refactor(mcp): drop the experimental label from the MCP server and client paths (#48513)	2026-10-27 17:47:50 +00:00
test_session_endpoints.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_sso_helper_utils.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_subscription_accounts.py	feat(usage): show subscription-covered providers and account fees separately (#44772)	2026-10-30 03:58:36 -07:00
test_tag_management_endpoints.py	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
test_team_admin_field_permissions.py	feat(proxy): let proxy admins open team metadata to team admins, keeping proxy settings with proxy admins (#46506)	2026-10-14 23:51:44 +00:00
test_team_callback_endpoints.py	feat(otel): let a team or key excluded_services override the global setting for its OTel v2 destination (#45880)	2026-10-12 19:25:52 -04:00
test_team_default_params.py	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
test_team_endpoints.py	fix(proxy)!: stop answering with the literal string "None" as error type and param on the proxy-server, auth, spend, and key health routes (#39540)	2026-10-29 18:20:52 -07:00
test_team_model_alias_merge.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_tool_management_endpoints.py	test(proxy): move management_endpoints, management_helpers and guardrails tests into tests/unit/proxy (#44003)	2026-10-01 10:52:03 -07:00
test_ui_sso.py	fix(sso): keep CLI SSO and Claude Code gateway team lists in the user record's order (#49033)	2026-10-30 05:07:00 -07:00
test_workflow_management_endpoints.py	test(proxy): move management_endpoints, management_helpers and guardrails tests into tests/unit/proxy (#44003)	2026-10-01 10:52:03 -07:00