mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-10 22:41:41 +00:00
635de7fe47
Version 2 replaces the scoring basis: difficulty evidence comes from the operations a request demands (reasoningDemand, domainDepth, constraintDensity, deliverableCount, outputScope, contextOperation, multiHop) instead of software vocabulary, a zero-weight taskType category rides the signals for evaluation, and SIMPLE requires positive triviality evidence. Below the simple_medium boundary everything else defaults to MEDIUM with the new routing decision cause insufficient_evidence, which also abstains to the LLM classifier under heuristic_first. A v2 abstention on a continuation turn inherits the conversation's tier instead, derived statelessly from the request's own history (cause insufficient_evidence_inherit), so agentic turns carrying terminal or tool output keep the tier the real ask earned, and a three-turn consecutive failure streak raises the inherited tier one step (progress-stall). Weights are provisional hand-set defaults pending calibration. Existing routers stay on version 1 so routing and spend do not move on upgrade. |
||
|---|---|---|
| .. | ||
| litellm-dashboard | ||
| Dockerfile | ||
| nginx.conf | ||