litellm/test-config
harish-berri aaa09bb086 Add negative caching for invalid virtual keys
- Introduced `InvalidVirtualKeyCache` to manage negative caching for unknown virtual keys, reducing unnecessary database lookups for invalid tokens.
- Updated `user_api_key_auth.py` to utilize the new cache for token validation.
- Added a new configuration constant for negative cache TTL.
- Implemented unit tests for the new caching mechanism to ensure correct behavior in various scenarios.
2026-04-29 00:11:43 +00:00
..
dev_config.yaml Add negative caching for invalid virtual keys 2026-04-29 00:11:43 +00:00