Yujong Lee
a4fda8f0d8
refactor(cache-qdrant-semantic): reuse immutable indexing params
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:48:24 +00:00
Yujong Lee
e0e4850ec1
merge(main): integrate upstream secret manager changes
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:48:18 +00:00
mateo-berri
073260ce5b
test(e2e): retry the hang-up when the model answers inside the window
2026-09-21 14:48:04 -07:00
Yujong Lee
b71e64446c
fix(cache-qdrant-semantic): annotate indexing wait payloads
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:56 +00:00
Yujong Lee
6a06f69972
fix(python-bridge): restore Qdrant dispatch after rebase
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:56 +00:00
Yujong Lee
ff2ca804b5
fix(python-bridge): preserve Qdrant facade dispatch after rebase
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:56 +00:00
Yujong Lee
acbec828db
fix(python-bridge): fall back to Python when qdrant_api_key changes after binding
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:56 +00:00
Yujong Lee
632c95f87e
fix(python-bridge): make the Qdrant config tests tolerate an unset OPENAI_API_KEY
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:56 +00:00
Yujong Lee
877d5da419
fix(cache-qdrant-semantic): wait for Qdrant upserts to be indexed
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:56 +00:00
Yujong Lee
fbaa535657
fix(python-bridge): ignore class data defaults in the facade guard
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:56 +00:00
Yujong Lee
93e9836524
feat(python-bridge): serve QdrantSemanticCache natively
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:56 +00:00
Yujong Lee
8d41336a1e
test(cache-qdrant-semantic): cover backend contract against an in-process Qdrant
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:56 +00:00
Yujong Lee
80c0ceb5e6
feat(cache-qdrant-semantic): add native Qdrant semantic cache backend
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:56 +00:00
Yujong Lee
fc3844e991
refactor(cache-response): generalize ResponseCache over the backend context
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:56 +00:00
Yujong Lee
0c72a94a84
feat(cache): add SemanticCacheContext and semantic error variants
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:56 +00:00
Yujong Lee
63c16fe5ac
Merge origin/main into litellm_native_disk_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:35 +00:00
Yujong Lee
1509afe77e
Merge remote-tracking branch 'origin/main' into litellm_gcs_native_cache
2026-09-21 21:47:29 +00:00
Yujong Lee
9f4448f42f
chore(rust): merge main into litellm_gcs_native_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:29 +00:00
Yujong Lee
95c1ba5e1d
Merge remote-tracking branch 'origin/main' into litellm_native_redis_semantic_cache
2026-09-21 21:47:22 +00:00
Yujong Lee
b926cf998a
chore: merge main into litellm_rust_secrets_azure_key_vault
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:47:21 +00:00
Yujong Lee
bc641f01ae
Merge remote-tracking branch 'origin/main' into litellm_native_azure_blob_cache
2026-09-21 21:47:19 +00:00
Yujong Lee
f24244a1a4
Merge remote-tracking branch 'origin/main' into litellm_native_redis_semantic_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
# Conflicts:
# litellm-rust/crates/cache-redis/src/cache.rs
# litellm-rust/crates/cache-redis/src/cache/operations.rs
# litellm-rust/crates/python-bridge/src/cache/config.rs
# litellm-rust/crates/python-bridge/src/cache/facade.rs
# litellm-rust/crates/python-bridge/src/cache/handle.rs
# litellm-rust/crates/python-bridge/src/cache/native.rs
# tests/test_litellm_rust/test_cache.py
2026-09-21 21:47:12 +00:00
yujonglee
ebb4d230f8
Merge pull request #42300 from BerriAI/litellm_python_interop_foundation
...
fix(rust): preserve Python settings semantics at the native boundary
2026-09-21 14:46:37 -07:00
Yujong Lee
3ebbb2af5b
Merge remote-tracking branch 'origin/main' into litellm_rust_cache_s3
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
# Conflicts:
# litellm-rust/Cargo.lock
# litellm-rust/crates/python-bridge/src/cache/config.rs
# litellm-rust/crates/python-bridge/src/cache/facade.rs
# litellm-rust/crates/python-bridge/src/cache/handle.rs
# tests/test_litellm_rust/test_cache.py
2026-09-21 21:46:22 +00:00
yujonglee
162e5c4338
Merge pull request #42303 from BerriAI/litellm_rust_secrets_cyberark
...
feat(rust): add CyberArk Conjur secret manager backend
2026-09-21 14:45:39 -07:00
Yujong Lee
4845beddc0
ci(rust): raise native wheel size gate to 40 MB
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:44:26 +00:00
Yujong Lee
f43f9012f1
fix(rust): handle disk cache topology
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:44:24 +00:00
Yassin Kortam
17b56cc4ca
Merge pull request #41505 from BerriAI/litellm_keep_config_models_on_empty_config_read
...
fix(proxy): keep config-defined deployments when a config read returns no model_list
2026-09-21 16:43:15 -05:00
Yujong Lee
2f54f6078d
chore: merge main into litellm_native_azure_blob_cache
...
Combines the Redis cluster bridge changes with the Azure Blob variant and
keeps account URL query parameters when building the container URL
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:43:08 +00:00
kerry-berri
75dc9082df
Merge pull request #42066 from BerriAI/litellm_cost_shard_batches_realtime
...
test(integration): batch and realtime cost cases
2026-09-21 14:43:01 -07:00
mateo-berri
51eaad657b
fix(proxy): look the entity spend table up lazily so only the selected batcher table is touched
2026-09-21 14:42:23 -07:00
Yujong Lee
98e9e8c602
Merge origin/main into litellm_native_disk_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:42:10 +00:00
kerry-berri
5e746d95dc
Merge pull request #42333 from BerriAI/litellm-providers/price-sync-openrouter
...
chore(prices): sync OpenRouter prices: 1 model
2026-09-21 14:41:07 -07:00
Joshua Valluru
5ec61e7a0b
chore: merge main into MCP ordering fix
2026-09-21 14:36:41 -07:00
Yujong Lee
d90ff4a30b
refactor(rust): trim vault cert login endpoint
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:35:39 +00:00
kerry
ebad623079
Merge remote-tracking branch 'origin/main' into litellm_cost_shard_batches_realtime
2026-09-21 21:34:05 +00:00
kerry-berri
29792c45a9
Merge pull request #42060 from BerriAI/litellm_cost_shard_proxy_behaviour
...
test(integration): proxy behaviour cost cases
2026-09-21 14:33:47 -07:00
Yujong Lee
ef2ab74c7a
refactor(rust): back the vault secret manager with vaultrs
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:33:38 +00:00
Yujong Lee
c7c0afb1f0
ci(rust): raise the native wheel size gate to 40 MB
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:33:06 +00:00
yucheng-berri
506cecfb0b
Merge pull request #42267 from BerriAI/litellm_otel_v2_langfuse_ocr_output
...
fix(otel v2): map OCR page markdown onto the generation output
2026-09-21 14:33:02 -07:00
Yujong Lee
b6b0e58ba3
refactor(cache-valkey-semantic): reuse cache-redis connection layer
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:32:42 +00:00
Yujong Lee
2a5112d146
feat(cache-redis): expose the pooled connection handling for reuse
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:32:40 +00:00
Yujong Lee
9c48e137dc
fix(rust): preserve HTTP host and TLS error context
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:32:33 +00:00
Yujong Lee
cc6ca5ee04
Merge origin/main into litellm_valkey_semantic_native_cache
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:32:33 +00:00
Yujong Lee
27808b51a0
chore(rust): drop interop planning note
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 21:32:33 +00:00
Yujong Lee
5aeb367d2a
fix(rust): preserve Python settings coercion at the native boundary
2026-09-21 21:32:33 +00:00
Yujong Lee
52216df1ff
fix(rust): preserve structured conversion semantics
2026-09-21 21:32:33 +00:00
Yujong Lee
a41061be43
docs(rust): plan Python interop foundation
2026-09-21 21:32:33 +00:00
Joshua Valluru
4c1a6309c2
test(mcp): type server fixtures and role queries
2026-09-21 14:31:28 -07:00
berriai-litellm-provider-info-sync[bot]
8c64f82bb3
chore(prices): sync OpenRouter prices: 1 model
...
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 21:31:16 +00:00