litellm/ui/litellm-dashboard/src
devin-ai-integration[bot] db3338b206
feat(proxy): make the in-memory management cache capacity configurable (#40725)
* feat(proxy): make the in-memory management cache capacity configurable

Add general_settings.user_api_key_cache_max_size (positive int, default 200) to resize the
in-memory tier of the shared user_api_key_cache at startup and on DB config reloads, expose it
in the Admin UI general settings, and cover it with behavioral tests. Prior art: #34726

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* fix(caching): resize the in-memory tier from DualCache so any cache instance honours the cap

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* style(proxy): wrap the cache capacity field description to the 120 col limit

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

---------

Co-authored-by: yassin <yassin@berri.ai>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-11 09:55:30 -07:00
..
app Merge pull request #40646 from BerriAI/litellm_key_table_entity_links 2026-09-10 18:27:12 -07:00
components fix(ui): name the popover copy buttons after the field they copy 2026-09-10 18:40:05 -07:00
contexts feat(ui): let admins supply a dark-mode variant of their custom logo (#37662) 2026-08-20 12:48:55 -07:00
data feat(ui): shadcn migration foundation: Tailwind v4, shadcn init, antd cascade fix (#31995) 2026-07-02 19:02:27 -07:00
hooks feat(ui): add a light/dark/system theme toggle to the top bar (#37669) 2026-08-20 12:58:29 -07:00
lib feat(proxy): make the in-memory management cache capacity configurable (#40725) 2026-09-11 09:55:30 -07:00
utils feat(ui): link the User, Team and Created By cells on the Virtual Keys page 2026-09-10 15:55:03 -07:00
types.ts added and ran prettier autoformatter 2025-10-04 18:19:48 -07:00