litellm/litellm-rust/crates/python-bridge
Yujong Lee b5a7064faf refactor(router): count io-token itpm and otpm on the native router_usage store
The io-token check reserves, reconciles and refunds its global_router itpm and
otpm counters through the native router_usage store, so ModelRateLimitingCheck
keeps no DualCache. A reservation stashes its counter's fields in the request
metadata instead of a Redis key, so nothing parses a key back into ids. The
Redis keys and values are unchanged, pinned by contract tests on both sides.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-10 16:45:58 +09:00
..
benches refactor(rust): add types and core-utils crates, unify the provider error 2026-09-17 22:01:14 -07:00
src refactor(router): count io-token itpm and otpm on the native router_usage store 2026-11-10 16:45:58 +09:00
tests refactor(rust): add types and core-utils crates, unify the provider error 2026-09-17 22:01:14 -07:00
AGENTS.md build(model-catalog): ship the cost map inside the native extension (#48907) 2026-10-29 07:55:02 -07:00
build.rs feat: package Rust OCR bridge in LiteLLM wheel (#31267) 2026-06-25 12:32:55 -07:00
Cargo.toml feat(redis): serve the proxy's common Redis call with Rust stores (#50170) 2026-11-06 06:01:11 +00:00
preflight_contract.json refactor(rust): move credential inheritance and the SDK limits out of the legacy callback crate into a driver preflight (#43259) 2026-09-26 01:09:36 +00:00