scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-03 02:22:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 81
52085 commits 3074 branches 1433 tags 4.2 GiB
Commit graph

13534 commits

Author SHA1 Message Date
Mateo Wang
2e35ae1065
Merge pull request #42049 from BerriAI/litellm_mantle_native_anthropic_messages 
feat(bedrock_mantle): serve /v1/messages for Claude models on Mantle's native Anthropic Messages API
 2026-09-21 12:52:16 -07:00
tin-berri
457b01e96d
Merge pull request #42055 from BerriAI/litellm_prompt_caching_request_table 
feat(ui): show prompt caching requests and net savings
 2026-09-21 12:45:11 -07:00
joshua-berri
211ff96943
Merge pull request #39189 from BerriAI/litellm_mcp_list_pagination_lit5594 
fix(mcp): paginate prompt and resource discovery
 2026-09-21 19:35:17 +00:00
Mateo Wang
0e7cf5113e
Merge pull request #42069 from BerriAI/litellm_redacted_thinking_prompt_caching_pin 
fix(token_counter): count replayed redacted_thinking blocks so prompt_caching keeps pinning
 2026-09-21 12:35:14 -07:00
Mateo Wang
d8267d507d
Merge pull request #41956 from BerriAI/litellm_explicit_cache_injection_points_survive_client_marks 
fix: apply configured cache_control_injection_points beside client cache_control marks
 2026-09-21 12:28:02 -07:00
Mateo Wang
e7e4df9098
Merge pull request #42041 from BerriAI/litellm_azure_ai_gpt5_tools_responses_bridge 
fix(azure_ai): bridge gpt-5.4+ function tools with reasoning to the Foundry Responses API
 2026-09-21 12:21:02 -07:00
Mateo Wang
9a90adad32
Merge pull request #42275 from BerriAI/litellm_claude_platform_messages_beta_passthrough 
fix(bedrock): forward anthropic-beta headers verbatim on the Claude platform messages path
 2026-09-21 12:01:39 -07:00
Yassin Kortam
5673f67727
Merge pull request #42022 from BerriAI/litellm_redis_durable_spend_log_buffer 
fix(proxy): park requeued spend logs in Redis so they survive a pod restart during a DB outage
 2026-09-21 14:01:34 -05:00
mateo-berri
2fe5c8990e fix(bedrock_mantle): bill Mantle's un-versioned Claude ids from a Mantle cost row 
Mantle serves anthropic.claude-haiku-4-5 without the dated -20251001-v1:0
suffix the Bedrock row carries, so the native route billed it at 0. Add a
bedrock_mantle/anthropic.claude-haiku-4-5 row and let a
bedrock_mantle/<region>/<model> name fall back to the region-free
bedrock_mantle/<model> row before the provider-prefixed lookup. Also
satisfy the mutable-collection gate in the native messages transformation.
 2026-09-21 12:00:38 -07:00
mateo-berri
4eed951e6f Merge commit '36b8be7d81b' into litellm_mantle_native_anthropic_messages_b4dc 
# Conflicts:
#	tests/test_litellm/llms/anthropic/experimental_pass_through/messages/test_anthropic_experimental_pass_through_messages_handler.py
 2026-09-21 12:00:37 -07:00
moe-berri
a83773cfa5
Merge pull request #41886 from BerriAI/litellm_jev_autorouter_launch_1789767495 
feat(auto-router): add JEV classifier alongside LLM classifier
 2026-09-21 11:55:44 -07:00
kerry-berri
12379aa1e3
Merge pull request #42095 from BerriAI/litellm_fal_gpt_image_25_flux_dev_edits 
feat(fal_ai): add gpt-image-2.5 flare/sunburst, flux/dev and image edits
 2026-09-21 11:45:45 -07:00
mateo-berri
e51ccbc759 fix(bedrock): forward anthropic-beta headers verbatim on the Claude platform messages path 2026-09-21 11:39:26 -07:00
mateo-berri
f567fe230e fix: reserve cap slots for direct marks on /v1/messages when extra_body unmarks them 2026-09-21 11:39:25 -07:00
Joshua Valluru
1499d84f5a fix(mcp): paginate optional discovery lists 2026-09-21 11:37:55 -07:00
mateo-berri
79d1af9d3c chore: merge origin/main to pick up the pre-call check test move 2026-09-21 11:28:04 -07:00
mateo-berri
c1ba76154e fix(litellm): pass a flat Responses-style function tool through the chat bridge unchanged 2026-09-21 11:14:59 -07:00
ryan-crabbe-berri
cc1a3157d3
Merge pull request #42121 from BerriAI/litellm_utils_model_info_lookup 
feat(proxy): add GET /utils/model_info to look up cost map info for unregistered models
 2026-09-21 10:42:28 -07:00
ryan-crabbe-berri
5573265013
Merge pull request #41906 from BerriAI/litellm_team_member_budget_source_reset 
feat(team): show whether a member follows the team default budget and allow resetting to it
 2026-09-21 10:34:08 -07:00
Moe Khalil
bb46e8b774 chore(auto-router): merge main and preserve JEV configuration 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 17:16:18 +00:00
yucheng-berri
51ae7ab1fd
Merge pull request #41588 from BerriAI/litellm_ui_session_personal_key_budget_ceiling 
* fix(key_generate): use user's budget for UI session personal keys

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* Update litellm/proxy/management_endpoints/key_management_endpoints.py

Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>

* fix(user_update): evict cached user on max_budget change so the personal key ceiling refreshes on every worker

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

---------

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: jesus-berri <jesus@berri.ai>
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: yucheng <yucheng@berri.ai>
 2026-09-21 10:11:29 -07:00
tin-berri
fe34fe6047
Merge pull request #42252 from BerriAI/litellm_heuristic_v2_success_threshold 
feat(auto-router): configure heuristic v2 success threshold
 2026-09-21 10:06:09 -07:00
yuneng-jiang
da76ba83ad
Merge pull request #42105 from BerriAI/litellm_flip_v2_migration_resolver_default 
feat(proxy): default to the v2 migration resolver
 2026-09-21 10:05:59 -07:00
yuneng
46383eec3c Merge remote-tracking branch 'origin/main' into litellm_migrate_tests_p17 2026-09-21 16:09:42 +00:00
Tin Chi Lo
a233ba910d feat(auto-router): configure heuristic v2 success threshold 2026-09-21 08:53:13 -07:00
Yassin Kortam
e912ebe999
Merge pull request #42152 from BerriAI/litellm_claude_code_safeguards_passthrough 
fix(anthropic): forward safeguards and anthropic-beta unchanged on native /v1/messages
 2026-09-21 10:12:44 -05:00
kerry-berri
701c2b7256
Merge pull request #34941 from BerriAI/litellm_azure_ai_mai_image_2_5_pro 2026-09-21 08:07:36 -07:00
Yassin Kortam
1ac4d7ae04 fix(anthropic): type safeguards and safeguard_results as the arrays Anthropic sends 
Driving a real Claude Code 2.1.278 through the proxy, and a direct call to
api.anthropic.com, both show these two fields are JSON arrays on the wire rather
than objects. The request carries safeguards as
[{"type": "dangerous_tool_use", "classifier_context": {...}}] under beta
dangerous-tool-use-2026-09-03, and the 200 comes back with safeguard_results as
[{"type": "dangerous_tool_use", "status": {"type": "available", "tool_uses": {...}}}].

No runtime change: the request filter matches on TypedDict keys and never inspects
the value. The test fixtures move to the captured shapes so the regression tests
pin what the client and the provider actually exchange.
 2026-09-21 09:55:09 -05:00
Yassin Kortam
32133a329c
Merge pull request #42239 from BerriAI/litellm_agentcore_a2a_message_stream 
fix(a2a): send message/stream for Bedrock AgentCore streaming requests
 2026-09-21 09:53:41 -05:00
yassin
6786eb0131 fix(a2a): send message/stream for Bedrock AgentCore streaming requests 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 13:39:32 +00:00
Yassin Kortam
def37c6532
Merge pull request #42097 from BerriAI/litellm_budget_exceeded_422 
fix(proxy): return 422 instead of 429 for BudgetExceededError
 2026-09-21 08:35:30 -05:00
Devin AI
d9a97d74db fix(model_prices): add groq qwen3.6-27b deprecation date and bedrock qwen3-next regional pricing 
Groq lists qwen/qwen3.6-27b for shutdown on 2026-09-14. Adds the six regional
Bedrock qwen.qwen3-next-80b-a3b entries priced per AWS's published regional
rates (absorbs #42191) with a regression test that the regional entry is used
instead of the US rate

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 13:21:50 +00:00
Devin AI
30adc1b2b9 Merge remote-tracking branch 'origin/main' into litellm_azure_ai_mai_image_2_5_pro 2026-09-21 13:20:20 +00:00
Devin AI
83223885e6 fix(responses): forward safety_identifier through the chat completion bridge 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 04:09:59 +00:00
Devin AI
53fe97975f Merge remote-tracking branch 'origin/main' into litellm_ui_session_personal_key_budget_ceiling
Some checks failed
LiteLLM Rust / rust-lint (push) Has been cancelled
Details
LiteLLM Rust / rust-test (push) Has been cancelled
Details
LiteLLM Rust / rust-wheel (push) Has been cancelled
Details
Terraform Modules / fmt, validate, test (aws) (push) Has been cancelled
Details
Terraform Modules / fmt, validate, test (gcp) (push) Has been cancelled
Details
Terraform Provider / gofmt, vet, build, test (push) Has been cancelled
Details
Terraform Provider / Provider endpoints vs proxy OpenAPI schema (push) Has been cancelled
Details 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

# Conflicts:
#	litellm/proxy/management_endpoints/internal_user_endpoints.py
 2026-09-20 19:40:05 +00:00
joshua-berri
b4d9231b31
Merge pull request #42148 from BerriAI/litellm_mcp_public_client_7740 
fix(mcp): explain missing public client dependencies
 2026-09-20 19:36:17 +00:00
joshua-berri
c25601fb5f
Merge pull request #42064 from BerriAI/litellm_fix_jwt_deactivated_users_8217 
fix(auth): reject deactivated JWT users and refresh cached status
 2026-09-20 19:35:53 +00:00
yuneng
a220fb7d30 test(a2a): migrate a2a_protocol legacy tests to tests/unit 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 19:23:52 +00:00
yuneng-jiang
7c4b805ca0
Merge pull request #42145 from BerriAI/litellm_migrate_tests_p13 
test: migrate legacy provider tests to tests/unit (wave 2, phase 13)
 2026-09-20 10:50:18 -07:00
yassin
b59028d525 fix(anthropic): strip safeguards on the adapter path and type it on streaming chunks 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 17:37:56 +00:00
yassin
3ebd5add32 fix(anthropic): forward safeguards and anthropic-beta unchanged on native /v1/messages 
Native Anthropic Messages requests derived their allowlist from
AnthropicMessagesRequestOptionalParams, which lacked safeguards, and the
shared beta-header filter dropped betas unknown to the provider mapping
even when the upstream is api.anthropic.com itself. Claude Code auto mode
then saw no safeguard_results and fell back to billed classifier calls

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 17:20:22 +00:00
kerry
342bde7a8d Merge remote-tracking branch 'origin/main' into litellm_fal_gpt_image_25_flux_dev_edits 2026-09-20 17:20:17 +00:00
kerry-berri
af1f46af1a
Merge pull request #41980 from BerriAI/litellm_fal_seedance_video 
feat(fal_ai): add Seedance 2.5 / 2.0 video generation via fal queue API
 2026-09-20 10:18:48 -07:00
Moe Khalil
93dddbf047 chore(auto-router): merge main budget fix into JEV classifier 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 17:16:48 +00:00
moe-berri
1e161f516c
Merge pull request #41879 from BerriAI/litellm_jev_test_budget_1789764884 
fix(proxy): enforce virtual key budgets for JEV test routing
 2026-09-20 10:10:21 -07:00
Joshua Valluru
671b51c959 chore: merge main for MCP OAuth CI compatibility 2026-09-20 09:18:25 -07:00
Moe Khalil
8505d10017 chore(auto-router): merge main into JEV launch branch 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 14:53:05 +00:00
yuneng-jiang
0f7d4dc13b
Merge pull request #42136 from BerriAI/litellm_migrate_tests_p15 
test: migrate phase 15 legacy tests to tests/unit
 2026-09-20 07:49:31 -07:00
yuneng-jiang
e0c7a4b19e
Merge pull request #42137 from BerriAI/litellm_migrate_tests_p12 
test: migrate phase 12 legacy llm provider tests to tests/unit
 2026-09-20 07:49:20 -07:00
yuneng-jiang
317f7cb69a
Merge pull request #42123 from BerriAI/litellm_migrate_tests_p1 
test: migrate wave 1 phase 1 legacy tests to tests/unit
 2026-09-20 07:49:08 -07:00