mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-14 23:21:35 +00:00
docs(ui): say on the card that a cold first turn is undercounted
The popover explained the counterfactual and stopped there, so nothing prepared a reader for a total below zero or for a first turn reading at a fraction of what it saved. The copy that did mention the cold-cache write was dropped in f66687b; this puts it back and adds the two consequences that follow from it.
This commit is contained in:
parent
d0b59af3aa
commit
bfe34130ed
1 changed files with 1 additions and 1 deletions
|
|
@ -204,7 +204,7 @@ const UsageTab: React.FC<UsageTabProps> = ({ accessToken, activity }) => {
|
|||
label="Auto-router savings"
|
||||
value={usd(autorouterTotal)}
|
||||
hint="vs. the priciest model it could pick"
|
||||
info="What this traffic would have cost had every request gone to the most expensive model the auto-router can route to, minus what it actually cost."
|
||||
info="What this traffic would have cost had every request gone to the most expensive model the auto-router can route to, minus what it actually cost. Switching leaves the new model with a cold cache, so it pays to write the prompt again while the baseline is priced as already warm; a route that thrashes the cache can total below zero, and a genuine first turn, where neither side had anything cached, is undercounted."
|
||||
/>
|
||||
</div>
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue