scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-25 01:02:15 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 131
51987 commits 2720 branches 1420 tags 3.5 GiB
Commit graph

18822 commits

Author SHA1 Message Date
kerry
4595d18047 Merge remote-tracking branch 'origin/main' into pr40429 2026-09-21 17:42:28 +00:00
ryan-crabbe-berri
5573265013
Merge pull request #41906 from BerriAI/litellm_team_member_budget_source_reset 
feat(team): show whether a member follows the team default budget and allow resetting to it
 2026-09-21 10:34:08 -07:00
yucheng-berri
51ae7ab1fd
Merge pull request #41588 from BerriAI/litellm_ui_session_personal_key_budget_ceiling 
* fix(key_generate): use user's budget for UI session personal keys

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* Update litellm/proxy/management_endpoints/key_management_endpoints.py

Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>

* fix(user_update): evict cached user on max_budget change so the personal key ceiling refreshes on every worker

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

---------

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: jesus-berri <jesus@berri.ai>
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: yucheng <yucheng@berri.ai>
 2026-09-21 10:11:29 -07:00
tin-berri
fe34fe6047
Merge pull request #42252 from BerriAI/litellm_heuristic_v2_success_threshold 
feat(auto-router): configure heuristic v2 success threshold
 2026-09-21 10:06:09 -07:00
yuneng-jiang
da76ba83ad
Merge pull request #42105 from BerriAI/litellm_flip_v2_migration_resolver_default 
feat(proxy): default to the v2 migration resolver
 2026-09-21 10:05:59 -07:00
yuneng
58729ac69f test(a2a): sort imports in merged bedrock agentcore test 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 16:10:40 +00:00
yuneng
46383eec3c Merge remote-tracking branch 'origin/main' into litellm_migrate_tests_p17 2026-09-21 16:09:42 +00:00
Tin Chi Lo
a233ba910d feat(auto-router): configure heuristic v2 success threshold 2026-09-21 08:53:13 -07:00
Yassin Kortam
e912ebe999
Merge pull request #42152 from BerriAI/litellm_claude_code_safeguards_passthrough 
fix(anthropic): forward safeguards and anthropic-beta unchanged on native /v1/messages
 2026-09-21 10:12:44 -05:00
kerry-berri
701c2b7256
Merge pull request #34941 from BerriAI/litellm_azure_ai_mai_image_2_5_pro 2026-09-21 08:07:36 -07:00
Yassin Kortam
1ac4d7ae04 fix(anthropic): type safeguards and safeguard_results as the arrays Anthropic sends 
Driving a real Claude Code 2.1.278 through the proxy, and a direct call to
api.anthropic.com, both show these two fields are JSON arrays on the wire rather
than objects. The request carries safeguards as
[{"type": "dangerous_tool_use", "classifier_context": {...}}] under beta
dangerous-tool-use-2026-09-03, and the 200 comes back with safeguard_results as
[{"type": "dangerous_tool_use", "status": {"type": "available", "tool_uses": {...}}}].

No runtime change: the request filter matches on TypedDict keys and never inspects
the value. The test fixtures move to the captured shapes so the regression tests
pin what the client and the provider actually exchange.
 2026-09-21 09:55:09 -05:00
Yassin Kortam
32133a329c
Merge pull request #42239 from BerriAI/litellm_agentcore_a2a_message_stream 
fix(a2a): send message/stream for Bedrock AgentCore streaming requests
 2026-09-21 09:53:41 -05:00
yassin
6786eb0131 fix(a2a): send message/stream for Bedrock AgentCore streaming requests 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 13:39:32 +00:00
Yassin Kortam
def37c6532
Merge pull request #42097 from BerriAI/litellm_budget_exceeded_422 
fix(proxy): return 422 instead of 429 for BudgetExceededError
 2026-09-21 08:35:30 -05:00
Devin AI
2888b4f5f4 fix(bedrock): whitelist regional qwen3-next keys for converse routing check 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 13:30:35 +00:00
Devin AI
d9a97d74db fix(model_prices): add groq qwen3.6-27b deprecation date and bedrock qwen3-next regional pricing 
Groq lists qwen/qwen3.6-27b for shutdown on 2026-09-14. Adds the six regional
Bedrock qwen.qwen3-next-80b-a3b entries priced per AWS's published regional
rates (absorbs #42191) with a regression test that the regional entry is used
instead of the US rate

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 13:21:50 +00:00
Devin AI
30adc1b2b9 Merge remote-tracking branch 'origin/main' into litellm_azure_ai_mai_image_2_5_pro 2026-09-21 13:20:20 +00:00
Devin AI
b38504b5a6 test(e2e): assert the forwarded Converse body without requiring the model to accept safety_identifier 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 07:37:28 +00:00
Devin AI
7e0fa40fe3 test(e2e): gate the Bedrock edge capture behind a provider_edge_host opt-in 
The Buildkite ephemeral stack runs the gateway in another pod, so it cannot reach the pytest host's provider edge. The GitHub changed-e2e lane runs gateways on the runner and sets E2E_PROVIDER_EDGE_HOST_REACHABLE

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 06:17:03 +00:00
Devin AI
ba93c7402a test(e2e): tolerate provider retries in safety_identifier capture assertion 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 04:53:10 +00:00
Devin AI
83223885e6 fix(responses): forward safety_identifier through the chat completion bridge 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 04:09:59 +00:00
Devin AI
53fe97975f Merge remote-tracking branch 'origin/main' into litellm_ui_session_personal_key_budget_ceiling
Some checks failed
LiteLLM Rust / rust-lint (push) Has been cancelled
Details
LiteLLM Rust / rust-test (push) Has been cancelled
Details
LiteLLM Rust / rust-wheel (push) Has been cancelled
Details
Terraform Modules / fmt, validate, test (aws) (push) Has been cancelled
Details
Terraform Modules / fmt, validate, test (gcp) (push) Has been cancelled
Details
Terraform Provider / gofmt, vet, build, test (push) Has been cancelled
Details
Terraform Provider / Provider endpoints vs proxy OpenAPI schema (push) Has been cancelled
Details 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

# Conflicts:
#	litellm/proxy/management_endpoints/internal_user_endpoints.py
 2026-09-20 19:40:05 +00:00
joshua-berri
b4d9231b31
Merge pull request #42148 from BerriAI/litellm_mcp_public_client_7740 
fix(mcp): explain missing public client dependencies
 2026-09-20 19:36:17 +00:00
joshua-berri
c25601fb5f
Merge pull request #42064 from BerriAI/litellm_fix_jwt_deactivated_users_8217 
fix(auth): reject deactivated JWT users and refresh cached status
 2026-09-20 19:35:53 +00:00
yuneng
a220fb7d30 test(a2a): migrate a2a_protocol legacy tests to tests/unit 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 19:23:52 +00:00
yuneng-jiang
7c4b805ca0
Merge pull request #42145 from BerriAI/litellm_migrate_tests_p13 
test: migrate legacy provider tests to tests/unit (wave 2, phase 13)
 2026-09-20 10:50:18 -07:00
yassin
b59028d525 fix(anthropic): strip safeguards on the adapter path and type it on streaming chunks 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 17:37:56 +00:00
yassin
3ebd5add32 fix(anthropic): forward safeguards and anthropic-beta unchanged on native /v1/messages 
Native Anthropic Messages requests derived their allowlist from
AnthropicMessagesRequestOptionalParams, which lacked safeguards, and the
shared beta-header filter dropped betas unknown to the provider mapping
even when the upstream is api.anthropic.com itself. Claude Code auto mode
then saw no safeguard_results and fell back to billed classifier calls

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 17:20:22 +00:00
kerry-berri
af1f46af1a
Merge pull request #41980 from BerriAI/litellm_fal_seedance_video 
feat(fal_ai): add Seedance 2.5 / 2.0 video generation via fal queue API
 2026-09-20 10:18:48 -07:00
moe-berri
1e161f516c
Merge pull request #41879 from BerriAI/litellm_jev_test_budget_1789764884 
fix(proxy): enforce virtual key budgets for JEV test routing
 2026-09-20 10:10:21 -07:00
yuneng
8554d1f827 test: prepare reference input before tracing path-sourced peak 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 17:08:16 +00:00
yuneng
e3911c71f7 test: make path-sourced streaming peak test differential 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 16:24:36 +00:00
Joshua Valluru
671b51c959 chore: merge main for MCP OAuth CI compatibility 2026-09-20 09:18:25 -07:00
yuneng
5ddf6ff396 test: restore pagination limit tests and realtime query param regression test 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 14:53:26 +00:00
yuneng-jiang
0f7d4dc13b
Merge pull request #42136 from BerriAI/litellm_migrate_tests_p15 
test: migrate phase 15 legacy tests to tests/unit
 2026-09-20 07:49:31 -07:00
yuneng-jiang
e0c7a4b19e
Merge pull request #42137 from BerriAI/litellm_migrate_tests_p12 
test: migrate phase 12 legacy llm provider tests to tests/unit
 2026-09-20 07:49:20 -07:00
yuneng-jiang
317f7cb69a
Merge pull request #42123 from BerriAI/litellm_migrate_tests_p1 
test: migrate wave 1 phase 1 legacy tests to tests/unit
 2026-09-20 07:49:08 -07:00
yuneng
a5033fff6e test: define local_model_cost_map fixture for migrated context caching tests 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 14:20:04 +00:00
yuneng
e1556ce32b test: migrate legacy provider tests to tests/unit (wave 2, phase 13) 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 14:18:49 +00:00
yuneng
d086f8574d test: add sync and async custom_llm_provider bridge propagation tests 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 13:46:52 +00:00
yuneng
30f3075010 test: use main's local_model_cost_map fixture in tests/unit/conftest.py 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 13:44:30 +00:00
yuneng
27dc080502 Merge remote-tracking branch 'origin/main' into litellm_migrate_tests_p15 2026-09-20 13:44:24 +00:00
yuneng
69133cc8cf Merge remote-tracking branch 'origin/main' into litellm_migrate_tests_p12 2026-09-20 13:44:19 +00:00
yuneng-jiang
8795d5f847
Merge pull request #42131 from BerriAI/litellm_migrate_tests_p16 
test: migrate phase 16 legacy tests to tests/unit
 2026-09-20 06:43:45 -07:00
yuneng-jiang
ec93936668
Merge pull request #42132 from BerriAI/litellm_migrate_tests_p14 
test: migrate phase 14 wave 2 provider tests to tests/unit
 2026-09-20 06:43:34 -07:00
yuneng-jiang
e5b2cabae5
Merge pull request #42128 from BerriAI/litellm_migrate_tests_p11 
test: migrate openai, openai_like and openrouter legacy tests to tests/unit
 2026-09-20 06:43:22 -07:00
yuneng
4fb1a3e610 test: add __init__.py to intermediate tests/unit packages 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 12:55:27 +00:00
yuneng
1ca0a662f0 Merge remote-tracking branch 'origin/main' into litellm_migrate_tests_p11 2026-09-20 12:55:05 +00:00
yuneng
affd2d0c30 merge: bring main (unit package markers) into litellm_migrate_tests_p3 2026-09-20 12:55:05 +00:00
yuneng
0237e69929 Merge remote-tracking branch 'origin/main' into litellm_migrate_tests_p16 2026-09-20 12:55:02 +00:00