Yujong Lee
c31fa2ae7a
Merge remote-tracking branch 'origin/main' into litellm_native_redis_semantic_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 23:51:16 +00:00
Yujong Lee
f24244a1a4
Merge remote-tracking branch 'origin/main' into litellm_native_redis_semantic_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
# Conflicts:
# litellm-rust/crates/cache-redis/src/cache.rs
# litellm-rust/crates/cache-redis/src/cache/operations.rs
# litellm-rust/crates/python-bridge/src/cache/config.rs
# litellm-rust/crates/python-bridge/src/cache/facade.rs
# litellm-rust/crates/python-bridge/src/cache/handle.rs
# litellm-rust/crates/python-bridge/src/cache/native.rs
# tests/test_litellm_rust/test_cache.py
2026-09-21 21:47:12 +00:00
Yujong Lee
2a5112d146
feat(cache-redis): expose the pooled connection handling for reuse
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:32:40 +00:00
Yujong Lee
96224f1c0f
fix(cache-redis): fan cluster PING out to every node and skip pool return pings
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:11:22 +00:00
Yujong Lee
83d4ce05c9
feat(rust-cache): serve RedisClusterCache natively as a Redis topology
...
Extend cache-redis so RedisTopology::Cluster routes single-key commands by
hash slot, groups pipelines by slot while keeping reply order, scans and
scoped-flushes every primary, and fans admin commands out to all nodes.
The bridge projects RedisClusterCache startup_nodes into the typed topology,
accepts the exact RedisClusterCache identity, guards nodes_manager state,
and falls back to Python for anything it cannot project.
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:49:21 +00:00
Yujong Lee
8d9ab9eeaa
feat(cache-redis): expose the pooled connection handling for reuse
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:24:23 +00:00
Yujong Lee
991108cc48
refactor(rust): align cache foundation with Python backends
2026-09-21 12:50:21 -07:00
Yujong Lee
22995d1575
fix(cache): remove redundant source comments
2026-09-21 11:23:47 -07:00
Yujong Lee
dc5f0c58a4
feat(cache): add native backend operation primitives
2026-09-21 10:21:54 -07:00
Yujong Lee
ef14fdaf33
fix(cache): harden native foundation parity
2026-09-21 09:53:41 -07:00
Yujong Lee
cc8cadebb4
fix(cache): close native parity gaps
2026-09-21 07:56:20 -07:00
Yujong Lee
0c3a0a2089
refactor(cache): separate response policy and host selection
2026-09-20 21:11:48 -07:00
Yujong Lee
081c93908f
feat(cache): add native response cache and Python binding foundations
2026-09-20 20:55:45 -07:00
Yujong Lee
95cf7066d1
refactor(cache): use static dispatch and typed backend codecs
2026-09-20 20:38:13 -07:00
Yujong Lee
93ba409adf
fix(rust): address Redis cache review findings
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-16 23:19:28 +00:00
Yujong Lee
0b3c3885bc
fix(rust): scope Redis dependency to cache crate
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-16 23:15:00 +00:00
Yujong Lee
8ae1f76339
feat(rust): scaffold redis cache crate
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-16 23:15:00 +00:00
