mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-16 23:41:43 +00:00
* fix(ui): distinguish response cache from provider prompt caching The log detail drawer labeled LiteLLM's response cache result as "Cache Hit" and rendered a red "false" tag next to provider prompt cache token counts, which read as prompt caching being broken. The row is now labeled "Response Cache" with an explanatory tooltip, shows a neutral "Miss" tag instead of a red one, and the prompt cache token rows are prefixed with "Prompt Cache" and get their own tooltips. Cost breakdown line items get the same prefix. The Caching dashboard only reports response cache analytics but never said so; it is renamed to "Response Cache" in the sidebar, gains a scope description pointing to the Usage page and Logs for prompt caching, and the ambiguous "Cached Tokens" stat card is renamed to "Cached Completion Tokens". * test(ui): cover renamed Response Cache sidebar item in e2e The sidebar navigation spec now clicks the renamed "Response Cache" item and asserts it routes to /ui/caching, and the menu label fixture maps the new label while keeping "Caching" as a legacy alias. Verified by running sidebar.spec.ts through run_e2e.sh (full harness: built UI served by the proxy, seeded postgres); both tests pass. * feat(ui): link cache tooltips and dashboard description to docs The Response Cache tooltip links to the proxy caching docs and the two prompt cache token tooltips link to the prompt caching docs, so users can jump straight to the explanation of whichever mechanism they are looking at. The Response Cache dashboard description links both docs pages the same way. |
||
|---|---|---|
| .. | ||
| auth | ||
| internal-user | ||
| internal-viewer | ||
| login | ||
| mcp | ||
| migration | ||
| modelHub | ||
| modelsPage | ||
| navigation | ||
| proxy-admin | ||
| settings | ||
| team-admin | ||
| users | ||