Etienne Chabert 372c096388 fix(proxy): evict a deleted key from every worker's auth cache (#47609) ... * fix(proxy): evict a deleted key from every worker's auth cache /key/delete dropped the key object only from the in-memory cache of the worker that served the call. Auth serves key objects cache-first, so every other worker, and the Redis copy when enable_redis_auth_cache is on, kept authenticating the deleted key until user_api_key_cache_ttl expired. /key/update already evicts and broadcasts through evict_and_broadcast, delete now does the same for the tokens it deletes * fix(proxy): evict only the deleted rows and broadcast them in one batch Scope the cross-worker eviction on /key/delete to the rows the caller was allowed to delete and send it through delete_cache_key_objects, so a caller-supplied name can no longer drop another team's cached entries on every worker * refactor(proxy): drop the comment above the delete eviction call * fix(proxy): run the usage cache eviction beside the auth eviction so a hung Redis costs one wait * test(proxy): wait on the broadcast instead of a sleep and type the peer eviction tests * test(proxy): wait for the peer to apply the broadcast instead of polling its cache * test(proxy): cover hashed keys and aliases when deleting a key warmed on a peer * fix(key_management): evict every requested key on delete, including keys whose row is already gone A batch delete that names a live key and a key whose row was removed outside the API evicted only the live key, so the gone key kept authenticating from every worker's cache. Every requested key hash is evicted now, while raw non-key cache keys are still left alone * test(key_management): split the gone-row eviction assertion into one comprehension per worker --------- Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>		2026-10-30 10:20:00 -07:00
..
__init__.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_admin_viewer_handler_access.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_auth_checks.py	fix(proxy): evict a deleted key from every worker's auth cache (#47609)	2026-10-30 10:20:00 -07:00
test_auth_checks_object_access_and_lookup.py	fix(proxy)!: scope /health by wildcard keys and team model allowlists the way auth does (#49155)	2026-10-30 07:36:01 -07:00
test_auth_exception_handler.py	fix(proxy)!: stop answering with the literal string "None" as error type and param on the proxy-server, auth, spend, and key health routes (#39540)	2026-10-29 18:20:52 -07:00
test_auth_hot_path_network_requests.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_auth_object_prefetch.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_auth_utils.py	feat(pass-through): add eu/jev decision API pass-through with spend tracking (#46875)	2026-10-29 17:52:43 -07:00
test_authorization.py	fix(proxy): share ownership permissions for spend logs and traces (#44239)	2026-10-03 01:38:54 +00:00
test_banned_params_extra_body.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_cli_auth.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_custom_auth_end_user_budget.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_default_end_user_budget_simple.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_fallback_budget.py	fix(router): report fallbacks skipped for access or budget instead of calling them failed (#46291)	2026-10-14 15:08:47 -07:00
test_fallback_model_access.py	fix(proxy): enforce fallback model access by default (#46127)	2026-10-13 07:58:53 -07:00
test_handle_jwt.py	fix(sso): keep CLI SSO and Claude Code gateway team lists in the user record's order (#49033)	2026-10-30 05:07:00 -07:00
test_info_routes.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_jwt.py	fix(proxy): refresh cached team on /team/block and /team/unblock (#35643)	2026-10-19 22:50:33 +00:00
test_litellm_license.py	fix(proxy): stop logging license values during verification (#44956)	2026-10-06 17:05:07 -07:00
test_login_utils.py	test: fix flaky spend-log cleanup budget, login lockout, and wedged Redis tests (#47108)	2026-10-29 03:46:32 -07:00
test_master_key_boot_check.py	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
test_mcp_ip_filtering.py	refactor(mcp): drop the experimental label from the MCP server and client paths (#48513)	2026-10-27 17:47:50 +00:00
test_model_access_group_budgets.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_model_checks.py	fix(proxy): list only routable models for a wildcard alias over a provider org (#49152)	2026-10-30 00:14:49 -07:00
test_model_checks_fallbacks.py	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
test_models_fallback_endpoint.py	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
test_multi_budget_windows.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_multipart_bypass_repro.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_network.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_oauth2_proxy_hook.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_object_permission_loading.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_onboarding.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_organization_budget_enforcement.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_password_hashing.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_password_policy.py	feat(proxy): add LITELLM_OFFLINE_MODE, one switch for the fetches LiteLLM makes on its own (#48096)	2026-10-23 16:54:19 -07:00
test_personal_key_team_model_access.py	feat(proxy): let personal keys inherit model access from the owner's current teams (#43692)	2026-10-13 00:17:35 +00:00
test_proxy_routes.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_rds_iam_token.py	fix(proxy): preserve AWS session tokens for RDS IAM auth (#46559)	2026-10-15 22:51:39 +00:00
test_resolvers_exceptions.py	fix(auth): return a generic 401 for an unknown key (#39787)	2026-10-15 01:05:25 -07:00
test_resolvers_grants.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_resolvers_models.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_resolvers_seam.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_resolvers_store.py	fix(auth): return a generic 401 for an unknown key (#39787)	2026-10-15 01:05:25 -07:00
test_route_checks.py	feat(pass-through): add eu/jev decision API pass-through with spend tracking (#46875)	2026-10-29 17:52:43 -07:00
test_router_override_fallback_auth.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_search_tool_deny_by_default.py	fix(proxy): scope dashboard search grants to user (#48464)	2026-10-26 15:01:40 -07:00
test_team_grants.py	test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy (#43998)	2026-10-01 10:11:45 -07:00
test_team_member_budget.py	feat(teams): show caller member spend and budget on Your Teams (#45674)	2026-10-24 17:09:55 -07:00
test_unmapped_model_budget_enforcement.py	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
test_user_api_key_auth.py	fix(proxy)!: stop answering with the literal string "None" as error type and param on the proxy-server, auth, spend, and key health routes (#39540)	2026-10-29 18:20:52 -07:00
test_user_api_key_auth_request_flow.py	fix(proxy)!: enforce an end user's per-model budget from their linked budget (#48815)	2026-10-28 21:24:11 -07:00