litellm/litellm-rust/docs
Nate Armstrong b83353906b
feat(gateway): enforce key, team, user, member and end-user budgets on shared spend counters (#47044)
Adds a built-in budgets hook that runs the proxy's budget checks, in its
order and with its messages, on the proxy's Redis spend:* counters. Each
request reads and seeds the counters, checks them and reserves its
maximum cost in one Redis script, then settles the reservation to its
real cost off the request path, so replicas and Python proxies sharing
the Redis enforce one budget. Without Redis the counters are kept per
replica. The key store now reads user, team member and end-user budgets,
and auth no longer checks budgets against stored spend.


Claude-Session: https://claude.ai/code/session_0138knkqKpkoSr6PApenZan5

Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-19 09:58:44 -07:00
..
adrs docs(rust): add ADRs for the Rust core (#45205) 2026-10-08 10:21:56 -07:00
customer-proxy feat(gateway): enforce key, team, user, member and end-user budgets on shared spend counters (#47044) 2026-10-19 09:58:44 -07:00