Yujong Lee
0116a502bc
Merge remote-tracking branch 'origin/main' into litellm_native_redis_semantic_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 22:53:48 +00:00
Yujong Lee
2129a94e56
Merge remote-tracking branch 'origin/main' into litellm_native_redis_semantic_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 22:13:38 +00:00
Yujong Lee
f7b96c9ced
Merge origin/main into litellm_native_disk_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 22:13:09 +00:00
Yujong Lee
8c82505964
fix(python-bridge): await semantic embeddings inline in the caller's task
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 22:02:52 +00:00
Yujong Lee
220b981ab4
test(rust): deduplicate the merged os import
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:53:18 +00:00
Yujong Lee
f24244a1a4
Merge remote-tracking branch 'origin/main' into litellm_native_redis_semantic_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
# Conflicts:
# litellm-rust/crates/cache-redis/src/cache.rs
# litellm-rust/crates/cache-redis/src/cache/operations.rs
# litellm-rust/crates/python-bridge/src/cache/config.rs
# litellm-rust/crates/python-bridge/src/cache/facade.rs
# litellm-rust/crates/python-bridge/src/cache/handle.rs
# litellm-rust/crates/python-bridge/src/cache/native.rs
# tests/test_litellm_rust/test_cache.py
2026-09-21 21:47:12 +00:00
Yujong Lee
2f54f6078d
chore: merge main into litellm_native_azure_blob_cache
...
Combines the Redis cluster bridge changes with the Azure Blob variant and
keeps account URL query parameters when building the container URL
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:43:08 +00:00
Yujong Lee
98e9e8c602
Merge origin/main into litellm_native_disk_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:42:10 +00:00
Yujong Lee
5acfcfa4fe
feat(rust): native Azure Blob response cache backend
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:00:48 +00:00
Yujong Lee
d3f2ddba05
fix(python-bridge): allow instance shadowing only for validated config attributes
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:58:02 +00:00
Yujong Lee
4a0151f77f
test(rust): add redis-semantic native parity fixtures
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:52:28 +00:00
Yujong Lee
83d4ce05c9
feat(rust-cache): serve RedisClusterCache natively as a Redis topology
...
Extend cache-redis so RedisTopology::Cluster routes single-key commands by
hash slot, groups pipelines by slot while keeping reply order, scans and
scoped-flushes every primary, and fans admin commands out to all nodes.
The bridge projects RedisClusterCache startup_nodes into the typed topology,
accepts the exact RedisClusterCache identity, guards nodes_manager state,
and falls back to Python for anything it cannot project.
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:49:21 +00:00
Yujong Lee
94b8bf7fd6
feat(rust): add native disk cache backend
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:37:26 +00:00
Yujong Lee
efcafa7f12
fix(rust): invalidate changed Redis pool settings
2026-09-21 12:30:17 -07:00
Yujong Lee
1b6b704ddd
refactor(cache): keep native foundation isolated
2026-09-21 11:15:44 -07:00
Yujong Lee
ef14fdaf33
fix(cache): harden native foundation parity
2026-09-21 09:53:41 -07:00
Yujong Lee
da402b8aee
fix(cache): preserve batch callback contracts
2026-09-21 08:27:17 -07:00
Yujong Lee
cc8cadebb4
fix(cache): close native parity gaps
2026-09-21 07:56:20 -07:00
Yujong Lee
0c3a0a2089
refactor(cache): separate response policy and host selection
2026-09-20 21:11:48 -07:00
Yujong Lee
081c93908f
feat(cache): add native response cache and Python binding foundations
2026-09-20 20:55:45 -07:00
