mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-08 22:21:35 +00:00
4e48d74455
The attempt row now prices the real arm (the payload's response_cost plus its own routing classifier when it routed) beside the shadow arm (completion plus the classifier cost the routing decision writes back), and flags turns litellm's response cache served. A per-leg funnel table counts the eligible requests that produced no row (lost the sampling dice, unjudgeable shape, concurrency shed), so results can weigh judged rows against the traffic they stand for. Job results gain per-slice and overall arm spends plus the coverage counts, the budget gates charge the shadow arm's classifier spend against max_budget, and the dashboard shows the measured cost comparison beside the win rate Resolves LIT-6358 Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| migrations | ||
| __init__.py | ||
| _logging.py | ||
| prisma_toolchain.py | ||
| py.typed | ||
| replica_identity.py | ||
| schema.prisma | ||
| utils.py | ||