litellm

mirror of https://github.com/BerriAI/litellm.git synced 2026-09-12 23:01:41 +00:00

History

Tin Chi Lo 4360c9fc43 feat(auto-router): scope shadow eval jobs to multiple keys A shadow eval job now covers a set of keys instead of exactly one, and each key carries its own max_turns budget, so one key exhausting its budget leaves its siblings sampling. Key, budget and stop state move to a new LiteLLM_ShadowEvalJobKey child table, taking the one-active-per-key partial unique index with them so the race-safe DB guarantee is unchanged. Attempts now record api_key_id, which is what makes per-key turn counting and the new by_key result slice possible The dashboard picker becomes a multi-select and the detail view gains a per key breakdown showing each key's own budget and status	2026-08-15 15:49:08 -07:00
..
test_litellm_proxy_extras_utils.py	feat(auto-router): scope shadow eval jobs to multiple keys	2026-08-15 15:49:08 -07:00

Tin Chi Lo 4360c9fc43 feat(auto-router): scope shadow eval jobs to multiple keys

A shadow eval job now covers a set of keys instead of exactly one, and each
key carries its own max_turns budget, so one key exhausting its budget leaves
its siblings sampling. Key, budget and stop state move to a new
LiteLLM_ShadowEvalJobKey child table, taking the one-active-per-key partial
unique index with them so the race-safe DB guarantee is unchanged. Attempts
now record api_key_id, which is what makes per-key turn counting and the new
by_key result slice possible

The dashboard picker becomes a multi-select and the detail view gains a per
key breakdown showing each key's own budget and status

2026-08-15 15:49:08 -07:00

test_litellm_proxy_extras_utils.py

feat(auto-router): scope shadow eval jobs to multiple keys

2026-08-15 15:49:08 -07:00