mirror of
https://github.com/BerriAI/litellm.git
synced 2026-11-16 09:22:22 +00:00
Add a two-arm input-cost quote for an assumed cache allocation. Each arm carries uncached, cache-read, five-minute write and one-hour write token buckets, so an operator can compare staying on a warm model with a cold switch using the configured deployment's pricing. The endpoint rejects ambiguous model groups unless a concrete deployment id identifies the arm and does not influence routing. Co-Authored-By: Claude Code <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| litellm-dashboard | ||
| Dockerfile | ||
| nginx.conf | ||