Yujong Lee
cb3e212e29
chore: merge main into litellm_gcs_native_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 22:08:55 +00:00
yujonglee
844d24b095
Merge pull request #42321 from BerriAI/litellm_native_azure_blob_cache
...
feat(rust): native Azure Blob response cache backend
2026-09-21 15:06:55 -07:00
yujonglee
41adbdaa05
Merge pull request #42309 from BerriAI/litellm_rust_secrets_azure_key_vault
...
feat(rust): add Azure Key Vault secret manager backend
2026-09-21 15:04:10 -07:00
Yujong Lee
1509afe77e
Merge remote-tracking branch 'origin/main' into litellm_gcs_native_cache
2026-09-21 21:47:29 +00:00
Yujong Lee
9f4448f42f
chore(rust): merge main into litellm_gcs_native_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:29 +00:00
Yujong Lee
b926cf998a
chore: merge main into litellm_rust_secrets_azure_key_vault
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:21 +00:00
Yujong Lee
bc641f01ae
Merge remote-tracking branch 'origin/main' into litellm_native_azure_blob_cache
2026-09-21 21:47:19 +00:00
yujonglee
ebb4d230f8
Merge pull request #42300 from BerriAI/litellm_python_interop_foundation
...
fix(rust): preserve Python settings semantics at the native boundary
2026-09-21 14:46:37 -07:00
yujonglee
162e5c4338
Merge pull request #42303 from BerriAI/litellm_rust_secrets_cyberark
...
feat(rust): add CyberArk Conjur secret manager backend
2026-09-21 14:45:39 -07:00
Yujong Lee
2f54f6078d
chore: merge main into litellm_native_azure_blob_cache
...
Combines the Redis cluster bridge changes with the Azure Blob variant and
keeps account URL query parameters when building the container URL
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:43:08 +00:00
Yujong Lee
9c48e137dc
fix(rust): preserve HTTP host and TLS error context
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:32:33 +00:00
Yujong Lee
5aeb367d2a
fix(rust): preserve Python settings coercion at the native boundary
2026-09-21 21:32:33 +00:00
Yujong Lee
52216df1ff
fix(rust): preserve structured conversion semantics
2026-09-21 21:32:33 +00:00
Yujong Lee
7c8f7d3f2c
fix(rust): reduce native wheel size
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:18:16 +00:00
Yujong Lee
0e281d458f
fix(rust): treat ConditionNotMet as an existing blob on sync Azure Blob writes
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:16:19 +00:00
Yujong Lee
96224f1c0f
fix(cache-redis): fan cluster PING out to every node and skip pool return pings
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:11:22 +00:00
Yujong Lee
5acfcfa4fe
feat(rust): native Azure Blob response cache backend
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:00:48 +00:00
Yujong Lee
83d4ce05c9
feat(rust-cache): serve RedisClusterCache natively as a Redis topology
...
Extend cache-redis so RedisTopology::Cluster routes single-key commands by
hash slot, groups pipelines by slot while keeping reply order, scans and
scoped-flushes every primary, and fans admin commands out to all nodes.
The bridge projects RedisClusterCache startup_nodes into the typed topology,
accepts the exact RedisClusterCache identity, guards nodes_manager state,
and falls back to Python for anything it cannot project.
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:49:21 +00:00
Yujong Lee
a6d1497932
test(rust): add GCS native cache parity fixtures
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:38:20 +00:00
Yujong Lee
7d597b2dd4
fix(rust): coalesce CyberArk authentication
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:36:59 +00:00
Yujong Lee
bfb4a8a2b3
refactor(rust): build Azure Key Vault auth inputs directly and keep credential tests offline
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:36:10 +00:00
Yujong Lee
ae69a8c79a
feat(rust): add Azure Key Vault secret manager backend
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:30:48 +00:00
Yujong Lee
ca31149040
feat(rust): add native GCS object-store cache backend
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:28:27 +00:00
Yujong Lee
fe6804ea74
refactor(rust): reject negative CyberArk refresh intervals
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:25:07 +00:00
Yujong Lee
4e2d4b5ff9
feat(rust): add CyberArk Conjur secret manager backend
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:23:54 +00:00
Yujong Lee
991108cc48
refactor(rust): align cache foundation with Python backends
2026-09-21 12:50:21 -07:00
Yujong Lee
efcafa7f12
fix(rust): invalidate changed Redis pool settings
2026-09-21 12:30:17 -07:00
Yujong Lee
14febcc878
fix(rust): shrink cache configuration bridge
2026-09-21 12:22:18 -07:00
Yujong Lee
59dbbe5ce7
fix(cache): outline Python configuration extraction
2026-09-21 12:10:06 -07:00
Yujong Lee
cda8904382
fix(cache): keep native wheel within size budget
2026-09-21 12:03:13 -07:00
Yujong Lee
a7bc8e373e
feat(cache): project Python backend configuration
2026-09-21 11:56:04 -07:00
Yujong Lee
22995d1575
fix(cache): remove redundant source comments
2026-09-21 11:23:47 -07:00
Yujong Lee
1b6b704ddd
refactor(cache): keep native foundation isolated
2026-09-21 11:15:44 -07:00
Yujong Lee
595711829a
wip
2026-09-21 10:30:42 -07:00
Yujong Lee
dc5f0c58a4
feat(cache): add native backend operation primitives
2026-09-21 10:21:54 -07:00
Yujong Lee
ef14fdaf33
fix(cache): harden native foundation parity
2026-09-21 09:53:41 -07:00
Yujong Lee
da402b8aee
fix(cache): preserve batch callback contracts
2026-09-21 08:27:17 -07:00
Yujong Lee
9783b7a377
docs(cache): align native cache follow-up scope
2026-09-21 07:56:58 -07:00
Yujong Lee
cc8cadebb4
fix(cache): close native parity gaps
2026-09-21 07:56:20 -07:00
Yujong Lee
0c3a0a2089
refactor(cache): separate response policy and host selection
2026-09-20 21:11:48 -07:00
Yujong Lee
081c93908f
feat(cache): add native response cache and Python binding foundations
2026-09-20 20:55:45 -07:00
Yujong Lee
95cf7066d1
refactor(cache): use static dispatch and typed backend codecs
2026-09-20 20:38:13 -07:00
Yujong Lee
e3f69fc4d8
refactor(rust): define consistent secret lookup contracts
2026-09-20 19:08:25 -07:00
Yujong Lee
82bc67b122
feat(rust): add typed secret managers and shared auth adapters
2026-09-20 16:09:20 -07:00
Yujong Lee
3fd2dd635b
refactor(rust): split auth facade from shared types
2026-09-20 15:45:38 -07:00
Yujong Lee
661da87c91
fix(rust): validate tokenizer ranks and cover backend features
2026-09-20 15:13:59 -07:00
Yujong Lee
56c5d31e73
test(rust): run fast token counter parity tests by default
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-20 21:52:48 +00:00
Yujong Lee
831810248a
refactor(rust): keep the Python token counter on the fast backend
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-20 21:49:39 +00:00
Yujong Lee
a619b765fc
refactor(rust): simplify tokenizer bridge features
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-20 21:25:19 +00:00
Yujong Lee
9b2b3d0b90
refactor(rust): align tokenizer docs and lint
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-20 21:21:52 +00:00
