Yujong Lee
3ebbb2af5b
Merge remote-tracking branch 'origin/main' into litellm_rust_cache_s3
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
# Conflicts:
# litellm-rust/Cargo.lock
# litellm-rust/crates/python-bridge/src/cache/config.rs
# litellm-rust/crates/python-bridge/src/cache/facade.rs
# litellm-rust/crates/python-bridge/src/cache/handle.rs
# tests/test_litellm_rust/test_cache.py
2026-09-21 21:46:22 +00:00
Yassin Kortam
17b56cc4ca
Merge pull request #41505 from BerriAI/litellm_keep_config_models_on_empty_config_read
...
fix(proxy): keep config-defined deployments when a config read returns no model_list
2026-09-21 16:43:15 -05:00
kerry
ebad623079
Merge remote-tracking branch 'origin/main' into litellm_cost_shard_batches_realtime
2026-09-21 21:34:05 +00:00
kerry-berri
29792c45a9
Merge pull request #42060 from BerriAI/litellm_cost_shard_proxy_behaviour
...
test(integration): proxy behaviour cost cases
2026-09-21 14:33:47 -07:00
yucheng-berri
506cecfb0b
Merge pull request #42267 from BerriAI/litellm_otel_v2_langfuse_ocr_output
...
fix(otel v2): map OCR page markdown onto the generation output
2026-09-21 14:33:02 -07:00
yucheng-berri
79d6e236f9
Merge pull request #39805 from BerriAI/litellm_mcp_admin_api_preserve_oauth_scopes
...
fix(mcp): keep oauth scopes in admin api credential redaction
2026-09-21 14:29:13 -07:00
kerry
1e54b4f286
Merge remote-tracking branch 'origin/litellm_cost_shard_proxy_behaviour' into litellm_cost_shard_batches_realtime
2026-09-21 21:25:05 +00:00
kerry
924ca78d06
Merge remote-tracking branch 'origin/main' into litellm_cost_shard_proxy_behaviour
2026-09-21 21:24:54 +00:00
Mateo Wang
124e5d6d53
Merge pull request #34358 from BerriAI/claude/e2e-tests-custom-endpoints-qxoi1o
...
test(e2e): replace custom endpoints_client with provider SDK clients
2026-09-21 14:24:38 -07:00
kerry-berri
34d5f9d41b
Merge pull request #42052 from BerriAI/litellm_cost_shard_provider_wires
...
test(integration): provider wire cost cases
2026-09-21 14:24:35 -07:00
Mateo Wang
4b9aa222a6
Merge pull request #42317 from BerriAI/litellm_redis_cluster_topology
...
feat(rust-cache): serve RedisClusterCache natively as a Redis topology
2026-09-21 14:21:54 -07:00
Yassin Kortam
f6c69af427
Merge pull request #41101 from hMED22/litellm_add_edenai_provider
...
feat(edenai): add Eden AI provider across chat, Responses, Messages, embeddings, audio, images and video
2026-09-21 16:16:28 -05:00
kerry
5ad36d2b7e
Merge remote-tracking branch 'origin/litellm_cost_shard_proxy_behaviour' into litellm_cost_shard_batches_realtime
2026-09-21 21:15:56 +00:00
kerry
2760ea2e6c
Merge remote-tracking branch 'origin/litellm_cost_shard_provider_wires' into litellm_cost_shard_proxy_behaviour
2026-09-21 21:15:49 +00:00
kerry
54a1e85d38
Merge remote-tracking branch 'origin/main' into litellm_cost_shard_provider_wires
2026-09-21 21:15:39 +00:00
Mateo Wang
fc82f6e8fa
Merge pull request #42288 from BerriAI/litellm_safeguards_bedrock_vertex_messages
...
fix(anthropic): forward Claude Code safeguards and dangerous-tool-use beta to Bedrock Invoke and Vertex on /v1/messages
2026-09-21 14:15:36 -07:00
kerry-berri
b5e47936e5
Merge pull request #42035 from BerriAI/litellm_cost_shard_pricing_dimensions
...
test(integration): pricing dimension and provider reported cost cases
2026-09-21 14:15:21 -07:00
Yassin Kortam
da1ccaec67
Merge pull request #40322 from BerriAI/litellm_lit7351_reservation_lease_renewal
...
fix(proxy): renew budget reservation counter TTL while the request is in flight
2026-09-21 16:07:14 -05:00
yuneng-jiang
5e0512b611
Merge pull request #42291 from BerriAI/litellm_lit7597_detach_credential
...
fix(proxy): detach stored credential when model editor selects None
2026-09-21 14:05:28 -07:00
kerry
6ef1003f7d
Merge remote-tracking branch 'origin/litellm_cost_shard_proxy_behaviour' into litellm_cost_shard_batches_realtime
2026-09-21 21:04:53 +00:00
kerry
3204bf0df9
Merge remote-tracking branch 'origin/litellm_cost_shard_provider_wires' into litellm_cost_shard_proxy_behaviour
2026-09-21 21:04:45 +00:00
kerry
5034b96fb6
Merge remote-tracking branch 'origin/litellm_cost_shard_pricing_dimensions' into litellm_cost_shard_provider_wires
2026-09-21 21:04:37 +00:00
kerry
b0070892da
Merge remote-tracking branch 'origin/main' into litellm_cost_shard_pricing_dimensions
2026-09-21 21:04:26 +00:00
kerry-berri
b5f02f72fe
Merge pull request #42028 from BerriAI/litellm_cost_shard_passthrough
...
test(integration): passthrough route cost cases
2026-09-21 14:04:03 -07:00
kerry-berri
89de508d6e
Merge pull request #42306 from BerriAI/litellm_fal_ai_surface_video_errors
...
fix(fal_ai): surface fal errors in video status and content instead of completed and generic 500
2026-09-21 13:59:04 -07:00
kerry-berri
f5f53a4cf4
Merge pull request #40429 from BerriAI/litellm_upgrade_banner_changelog_stats
...
feat(ui): add upgrade banner with latest release changelog stats
2026-09-21 13:56:05 -07:00
kerry
6f6b525d7a
chore: merge litellm_cost_shard_proxy_behaviour into litellm_cost_shard_batches_realtime
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:50:46 +00:00
kerry
94b8842928
chore: merge litellm_cost_shard_provider_wires into litellm_cost_shard_proxy_behaviour
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:50:28 +00:00
kerry
edc34a2921
chore: merge litellm_cost_shard_pricing_dimensions into litellm_cost_shard_provider_wires
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:49:55 +00:00
Yujong Lee
83d4ce05c9
feat(rust-cache): serve RedisClusterCache natively as a Redis topology
...
Extend cache-redis so RedisTopology::Cluster routes single-key commands by
hash slot, groups pipelines by slot while keeping reply order, scans and
scoped-flushes every primary, and fans admin commands out to all nodes.
The bridge projects RedisClusterCache startup_nodes into the typed topology,
accepts the exact RedisClusterCache identity, guards nodes_manager state,
and falls back to Python for anything it cannot project.
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:49:21 +00:00
kerry
19e6ad5b1b
test(integration): give perplexity sonar-next a unique input rate after merge
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:48:40 +00:00
kerry
7ca6fda118
chore: merge litellm_cost_shard_passthrough into litellm_cost_shard_pricing_dimensions
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:47:34 +00:00
kerry
61ea3e0226
chore: merge litellm_cost_shard_audio_images into litellm_cost_shard_passthrough
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:46:44 +00:00
kerry
0b9035b48f
fix(fal_ai): handle transient result errors and inject clients
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:45:58 +00:00
yassin
930c7e2638
fix(utils): drop model from extra_body for openai-compatible providers
...
A caller-supplied extra_body model overrode the authorized model in the request the shared HTTP handler sends upstream. Strip it before dispatch
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:43:08 +00:00
kerry
0afb9bb587
chore: merge main into litellm_cost_shard_audio_images
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:36:48 +00:00
Yujong Lee
788e24655a
feat(rust): add native S3 cache backend
...
Mirror the Redis vertical slice for S3Cache: a litellm-cache-s3 crate built on aws-sdk-s3 with path-style custom endpoints, python-identical put_object metadata (cache-control, expires, content headers), expires-aware get_object, and no-op flush/unsupported test_connection. Wire it through python-bridge config projection, facade guards, test handle, and binding dispatch, plus an in-process S3 stub and parity tests.
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:35:08 +00:00
kerry
eaa6936f13
fix(fal_ai): carry fal response into content errors
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:27:08 +00:00
kerry-berri
89e13ee959
chore: merge litellm_cost_shard_proxy_behaviour into litellm_cost_shard_batches_realtime
2026-09-21 20:25:25 +00:00
kerry-berri
1f71e4c8f5
chore: merge litellm_cost_shard_provider_wires into litellm_cost_shard_proxy_behaviour
2026-09-21 20:25:21 +00:00
kerry-berri
5d3dfe9b70
chore: merge litellm_cost_shard_pricing_dimensions into litellm_cost_shard_provider_wires
2026-09-21 20:25:17 +00:00
kerry-berri
5b51be83b8
chore: merge litellm_cost_shard_passthrough into litellm_cost_shard_pricing_dimensions
2026-09-21 20:25:13 +00:00
kerry-berri
f63a85e9cc
chore: merge litellm_cost_shard_audio_images into litellm_cost_shard_passthrough
2026-09-21 20:25:10 +00:00
mateo-berri
61fcfd986d
fix(anthropic): map the dangerous-tool-use beta for Bedrock Mantle so safeguards never reach it without the beta
2026-09-21 13:24:52 -07:00
kerry-berri
134c7111a5
chore: merge litellm_cost_shard_harness_extensions into litellm_cost_shard_audio_images
2026-09-21 20:24:37 +00:00
kerry-berri
7b1283ba18
chore: merge litellm_cost_shard_harness_extensions into litellm_cost_shard_embeddings_rerank
2026-09-21 20:24:32 +00:00
kerry
1ae2c0938a
chore: merge main into litellm_cost_shard_harness_extensions
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:23:58 +00:00
mateo-berri
bdbb4cf527
test(e2e): send no-cache on rerank bodies like the other request models
2026-09-21 13:20:06 -07:00
Mateo Wang
662e5b6e32
Merge pull request #42284 from BerriAI/litellm_qianwen_ai_platform_rename
...
fix: rename the mainland China brand to Qianwen AI Platform
2026-09-21 13:18:20 -07:00
kerry
a909a7908e
fix(fal_ai): surface fal errors in video status and content
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 20:17:29 +00:00