litellm/litellm-rust
Yujong Lee 3df56d9366 refactor(redis): keep the selector prefetch and tier policy on the Python host
The cooldown store no longer takes the v2 selector's DualCache and raw
keys. The selector prefetch moves next to its caller in router_utils, and
the store surface is model ids only, so a Rust-backed store never mixes a
redis-py read into its own call

The Rust tier policy now comes from the host. main reads the cooldown
refresh interval and the batch throttle size from the environment and the
usage refresh from litellm.default_redis_batch_cache_expiry, so a new
router_tiers accessor in litellm/rust_bridge/host/settings.py reports
them and both pyclasses build their store with those values. POLICY in
redis-store stays as main's defaults

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-11-01 05:46:32 +00:00
..
.agents/skills refactor(rust): extract SecretValue and use it for Redis credentials (#49186) 2026-10-30 11:31:04 -07:00
crates refactor(redis): keep the selector prefetch and tier policy on the Python host 2026-11-01 05:46:32 +00:00
docs/adrs docs(rust): add ADRs for the Rust core (#45205) 2026-10-08 10:21:56 -07:00
.gitignore feat: add LiteLLM Rust workspace with Mistral OCR bridge (#31033) 2026-06-23 13:16:47 -07:00
AGENTS.md feat(config): resolve Redis settings the way litellm/_redis.py does 2026-11-01 04:27:51 +00:00
Cargo.lock feat(redis): run router cooldowns and usage on the Rust store 2026-11-01 05:46:32 +00:00
Cargo.toml feat(redis): run router cooldowns and usage on the Rust store 2026-11-01 05:46:32 +00:00
clippy.toml build(rust): upgrade reqwest to 0.13 and move MCP out of litellm-http (#48039) 2026-10-28 07:32:40 -07:00