scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-25 01:02:15 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 131
litellm/litellm-rust
History
Yujong Lee 83d4ce05c9 feat(rust-cache): serve RedisClusterCache natively as a Redis topology 
Extend cache-redis so RedisTopology::Cluster routes single-key commands by
hash slot, groups pipelines by slot while keeping reply order, scans and
scoped-flushes every primary, and fans admin commands out to all nodes.
The bridge projects RedisClusterCache startup_nodes into the typed topology,
accepts the exact RedisClusterCache identity, guards nodes_manager state,
and falls back to Python for anything it cannot project.

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:49:21 +00:00
..
crates feat(rust-cache): serve RedisClusterCache natively as a Redis topology 2026-09-21 20:49:21 +00:00
.gitignore feat: add LiteLLM Rust workspace with Mistral OCR bridge (#31033) 2026-06-23 13:16:47 -07:00
Cargo.lock feat(rust-cache): serve RedisClusterCache natively as a Redis topology 2026-09-21 20:49:21 +00:00
Cargo.toml feat(cache): add native response cache and Python binding foundations 2026-09-20 20:55:45 -07:00
clippy.toml wip 2026-09-19 10:36:59 -07:00