mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-21 00:21:49 +00:00
- Introduced `InvalidVirtualKeyCache` to manage negative caching for unknown virtual keys, reducing unnecessary database lookups for invalid tokens. - Updated `user_api_key_auth.py` to utilize the new cache for token validation. - Added a new configuration constant for negative cache TTL. - Implemented unit tests for the new caching mechanism to ensure correct behavior in various scenarios. |
||
|---|---|---|
| .. | ||
| dev_config.yaml | ||