Mateo Wang
ace28fd97a
Merge pull request #37384 from daniel-meismer-zocdoc/litellm_mcp_dcr_bridge_complete_challenges
...
fix(mcp): complete DCR bridge OAuth challenges
2026-08-26 12:07:54 -07:00
Mateo Wang
8dc17e808a
Merge pull request #38240 from BerriAI/devin_ai_anthropic_messages_missing_key
...
fix(anthropic): raise missing-credential error on /v1/messages passthrough
2026-08-26 12:06:37 -07:00
Mateo Wang
c13b278d79
Merge pull request #38369 from BerriAI/litellm_anthropic_geo_uplift_missing_models
...
fix(cost-map): add US data residency uplift to claude-sonnet-4-6 and mythos entries
2026-08-26 12:05:25 -07:00
mateo-berri
cbb50bb37e
fix(responses): flush streaming cache write cancelled at event loop shutdown
2026-08-26 12:05:11 -07:00
Mateo Wang
c7b9060fb1
Merge pull request #38291 from BerriAI/devin_ai_lit6160_health_check_image_edit_mode
...
fix(health): support `mode: image_edit` in health checks
2026-08-26 12:04:53 -07:00
Devin AI
0cc407a02d
Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_registry_audit_bedrock_sol_anthropic_1hr
2026-08-26 19:02:56 +00:00
mateo-berri
50f69a3a81
fix(health): strip client_secret, azure_ad_token, and other credential fields from /health output
2026-08-26 12:00:13 -07:00
Mateo Wang
0ada822928
Merge pull request #38094 from eugene-yao-zocdoc/litellm_redis_credential_provider
...
fix(redis): support credential providers across clients
2026-08-26 11:59:56 -07:00
mateo-berri
8a2fc2cc9f
Merge remote-tracking branch 'origin/litellm_internal_staging' into fix/gh-36898-health-leak-extra-headers
2026-08-26 11:57:55 -07:00
yucheng-berri
ede4f3e8ab
test(prometheus): cover caller-identity config failure cases ( #38380 )
...
* test(prometheus): cover caller-identity config failure cases
* test(prometheus): narrow pytest.raises with match to satisfy PT011
2026-08-26 11:53:49 -07:00
mateo-berri
c5e3b21019
test(utils): add priority cache write tier key to intended map schema
2026-08-26 11:51:57 -07:00
Mateo Wang
80843ae7cb
Merge pull request #38279 from 6matt/litellm_bedrock_converse_gpt5_reasoning_effort
...
fix(bedrock): map reasoning_effort to reasoning.effort for OpenAI GPT-5.x on Converse
2026-08-26 11:48:18 -07:00
mateo-berri
1a696de40c
fix(caching): flush async cache writes cancelled at event loop shutdown
2026-08-26 11:47:10 -07:00
Yuneng Jiang
91e7eb115d
fix(proxy): sync search tools into the router on management writes
...
Creating a search tool through the UI only wrote the row; the router was updated
solely by the add_deployment job, so the tool was unusable for up to
PROXY_CONFIG_RELOAD_INTERVAL_SECONDS (30s by default) even on the worker that
served the write. Tools declared in config.yaml load straight into the router at
startup, which is why they never showed the delay.
The create, update and delete endpoints now refresh the router inline, matching
what the MCP server endpoints already do. The refresh is best-effort: the row is
already committed, so a failure must not surface as a 500 and push the caller
into a retry that creates duplicates.
Two related gaps go with it. _init_search_tools_in_db skipped the router update
whenever the merged list came back empty, so deleting the last search tool left
it live in memory forever. And in store_model_in_db-off deployments the
add_deployment job is never scheduled, so DB-backed search tools never reached
the router at all; that branch now loads them at startup and keeps them fresh on
its own interval, the same way MCP servers already do.
2026-08-26 11:46:54 -07:00
mateo-berri
c330d466f3
fix(anthropic): normalize oauth authorization header to one canonical casing
2026-08-26 11:45:51 -07:00
Mateo Wang
767e6015af
Merge pull request #34658 from BerriAI/litellm_azure_realtime_entra_id_auth
...
fix(azure/realtime): authenticate realtime websocket with Azure AD token when no api-key
2026-08-26 11:44:38 -07:00
Mateo Wang
2d3144c6c8
Merge pull request #38368 from BerriAI/litellm_fix_bedrock_mantle_gpt55_gpt54_context_window
...
fix(model_prices): raise bedrock_mantle gpt-5.5 and gpt-5.4 max_input_tokens to Mantle's enforced 1050000
2026-08-26 11:42:47 -07:00
mateo-berri
dbe52a80c1
test(cost): wrap overlong us data residency test declaration
2026-08-26 11:42:28 -07:00
mateo-berri
e97a84afcf
fix(model_prices): add above-272k priority rates to azure us/eu gpt-5.6 entries
2026-08-26 11:40:19 -07:00
yuneng-jiang
7bc80994b7
Merge pull request #38305 from BerriAI/litellm_/testing-strategy-audit-c39e33
...
fix(ci): let the mutation workflow find covered lines so it generates mutants
2026-08-26 11:34:08 -07:00
mateo-berri
9c38f6f125
test(tencent): drive thinking tests off the real cost map instead of patched internals
2026-08-26 11:34:06 -07:00
yuneng-jiang
b03e913ccf
Merge pull request #38315 from BerriAI/litellm_cost_estimate_pricing_edges
...
test(cost-estimate): pin the prices and period totals /cost/estimate returns
2026-08-26 11:32:22 -07:00
mateo-berri
8307be68c9
Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_pr38100_tencent_thinking
2026-08-26 11:26:58 -07:00
mateo-berri
229e136783
fix(mcp): honor admin-entered OAuth URLs on authorize after issuer yield
...
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-26 11:26:54 -07:00
Mateo Wang
ca6387fae7
Merge pull request #38271 from daniel-meismer-zocdoc/litellm_mcp_bridge_provider_token_lifetime
...
fix(mcp): preserve provider access token lifetime
2026-08-26 11:25:55 -07:00
Mateo Wang
def5ca6d68
Merge pull request #38299 from BerriAI/litellm_fix_vertex_pt_custom_auth_google_token
...
fix(proxy): keep the caller's Google token on credential-less Vertex passthrough under custom auth
2026-08-26 11:24:56 -07:00
yuneng-jiang
309da5e70e
Merge branch 'litellm_internal_staging' into litellm_/testing-strategy-audit-c39e33
2026-08-26 11:24:55 -07:00
mateo-berri
a0d1fef89d
fix(anthropic): scale cache costs by fast mode and trust served speed
2026-08-26 11:24:12 -07:00
mateo-berri
8ff832901b
fix(health): accept image_edit mode on /health/test_connection
2026-08-26 11:18:50 -07:00
mateo-berri
2068066d69
fix(anthropic): detect oauth Authorization header case-insensitively
2026-08-26 11:16:17 -07:00
Devin AI
f3c1e2e2a7
fix(guardrails): forward aws_external_id when the bedrock guardrail assumes a role
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-08-26 18:12:15 +00:00
Mateo Wang
47cfd3f5ca
Merge pull request #38371 from BerriAI/litellm_fix_claude3_1hr_cache_pricing
...
fix(model_prices): price 1-hour cache writes on claude-3-haiku and claude-3-opus at 2x input
2026-08-26 11:11:46 -07:00
Mateo Wang
a6754fa619
Merge pull request #38272 from daniel-meismer-zocdoc/litellm_hidden_alias_explicit_lookup
...
fix(router): resolve hidden aliases for explicit lookup
2026-08-26 10:56:26 -07:00
Mateo Wang
d46bcde2b5
Merge pull request #37922 from BerriAI/litellm_techdebt_20260822
...
chore(typing): roll up the daily tech debt cleanups from Aug 20 to Aug 26
2026-08-26 10:54:50 -07:00
mateo-berri
764048750e
fix(mcp): name invalid_token challenges by the caller's requested spelling
2026-08-26 10:52:28 -07:00
mateo-berri
b349b9bf50
fix(pricing): add azure gpt-5.6 cache write rates and correct data zone priority
2026-08-26 10:50:44 -07:00
mateo-berri
6416a97a4d
fix(model_prices): price 1-hour cache writes on claude-3-haiku and claude-3-opus at 2x input
2026-08-26 10:48:49 -07:00
mateo-berri
dcffd1da52
refactor(redis): drop docstrings restating the code
2026-08-26 10:45:56 -07:00
mateo-berri
a2cd2d8a4b
fix(cost-map): add US data residency uplift to claude-sonnet-4-6 and mythos entries
2026-08-26 10:43:43 -07:00
mateo-berri
a3f654719e
fix(proxy): strip the JWT that authenticated on credential-less Vertex passthrough
2026-08-26 10:43:04 -07:00
mateo-berri
b97d5e77eb
fix(model_prices): raise bedrock_mantle gpt-5.5 and gpt-5.4 max_input_tokens to Mantle's enforced 1050000
2026-08-26 10:42:00 -07:00
Mateo Wang
95285c3433
Merge pull request #38211 from eugene-yao-zocdoc/litellm_anthropic_responses_strictness_pr
...
fix(anthropic-responses): preserve structured output strictness
2026-08-26 10:39:45 -07:00
devin-ai-integration[bot]
c11c654b8e
fix(proxy): honor DATABASE_DISABLE_PREPARED_STATEMENTS in componentized entrypoints ( #38363 )
...
Co-authored-by: yassin <yassin@berri.ai>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-08-26 10:39:04 -07:00
mateo-berri
0bfc733278
Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_techdebt_20260822
2026-08-26 10:35:55 -07:00
mateo-berri
c449f11451
fix(anthropic): detect client credential headers case-insensitively on /v1/messages
2026-08-26 10:35:39 -07:00
Devin AI
07c9812739
fix(model_prices): carry anthropic behavior flags on deepinfra claude entries, move retired together models to deprecated list
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-08-26 17:18:51 +00:00
Devin AI
d266326a42
fix(model_prices): azure gpt-4.1-nano retirement date, together deprecations, novita gpt-oss-120b vision flag, fireworks deepseek-v4-pro-0813
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-08-26 16:56:53 +00:00
Devin AI
9300018414
Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_registry_audit_bedrock_sol_anthropic_1hr
2026-08-26 16:46:44 +00:00
Mateo Wang
cdb60af024
Merge pull request #38269 from BerriAI/litellm_together_structured_outputs
...
fix(together_ai): fail open on response_format instead of dropping it for unregistered models
2026-08-26 09:34:56 -07:00
Mateo Wang
c81ceba431
Merge pull request #38232 from BerriAI/litellm_e2e_bedrock_customer_matrix
...
test(e2e): cover the Bedrock provider-feature cells customers run
2026-08-26 09:34:07 -07:00
