scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-24 00:52:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 91
51982 commits 2663 branches 1420 tags 3.4 GiB
Commit graph

51982 commits

This branch
This branch
All branches
Author SHA1 Message Date
kerry
795239de20 fix: add xai/grok-4.7 to model cost map backup file 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 17:59:09 +00:00
kerry
38fc7d6dca feat(xai): add grok-4.7 to the cost map 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 17:57:32 +00:00
ryan-crabbe-berri
cc1a3157d3
Merge pull request #42121 from BerriAI/litellm_utils_model_info_lookup 
feat(proxy): add GET /utils/model_info to look up cost map info for unregistered models
 2026-09-21 10:42:28 -07:00
kerry-berri
1fbfb460e1
Merge pull request #42261 from BerriAI/litellm-providers/price-sync-openrouter 
chore(prices): sync OpenRouter prices: 7 models
 2026-09-21 10:40:56 -07:00
kerry-berri
01bdda72ba
Merge pull request #42254 from BerriAI/litellm-providers/price-sync-aws-bedrock 
chore(prices): sync AWS Bedrock prices: 13 models, 1 new [1 with gaps, enrichment failed: AWS Bedrock, 38 held]
 2026-09-21 10:40:33 -07:00
ryan-crabbe-berri
5573265013
Merge pull request #41906 from BerriAI/litellm_team_member_budget_source_reset 
feat(team): show whether a member follows the team default budget and allow resetting to it
 2026-09-21 10:34:08 -07:00
berriai-litellm-provider-info-sync[bot]
00b298a36d
chore(prices): sync AWS Bedrock prices: 13 models, 1 new [1 with gaps, enrichment failed: AWS Bedrock, 38 held] 
deepseek.v3.2: max_tokens, supports_vision, max_input_tokens, max_output_tokens, supports_audio_input, supports_response_schema
global.moonshotai.kimi-k3: supports_vision, max_input_tokens, supports_audio_input, supports_response_schema, supports_function_calling, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, cache_creation_input_token_cost, supports_tool_choice, supports_prompt_caching
google.gemma-3-12b-it: max_tokens, max_output_tokens, supports_audio_input, supports_response_schema, supports_function_calling
google.gemma-3-4b-it: max_tokens, max_output_tokens, supports_audio_input, supports_function_calling
mistral.devstral-2-123b: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema
mistral.magistral-small-2509: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema
mistral.ministral-3-14b-instruct: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema
mistral.ministral-3-8b-instruct: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema
mistral.mistral-large-3-675b-instruct: max_tokens, supports_vision, max_input_tokens, max_output_tokens, supports_audio_input, supports_response_schema
moonshotai.kimi-k2.5: max_tokens, max_input_tokens, max_output_tokens, supports_audio_input, supports_response_schema
nvidia.nemotron-nano-3-30b: max_tokens, supports_vision, max_input_tokens, max_output_tokens, supports_audio_input, supports_response_schema
nvidia.nemotron-nano-9b-v2: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema, supports_function_calling
nvidia.nemotron-super-3-120b: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema
 2026-09-21 17:31:49 +00:00
berriai-litellm-provider-info-sync[bot]
bed94a48d9
chore(prices): sync OpenRouter prices: 7 models 
openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/~moonshotai/kimi-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/ibm-granite/granite-4.2-8b: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/moonshotai/kimi-k3: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/qwen/qwen3.8-27b: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
 2026-09-21 17:31:40 +00:00
yucheng-berri
51ae7ab1fd
Merge pull request #41588 from BerriAI/litellm_ui_session_personal_key_budget_ceiling 
* fix(key_generate): use user's budget for UI session personal keys

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* Update litellm/proxy/management_endpoints/key_management_endpoints.py

Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>

* fix(user_update): evict cached user on max_budget change so the personal key ceiling refreshes on every worker

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

---------

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: jesus-berri <jesus@berri.ai>
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
Co-authored-by: yucheng <yucheng@berri.ai>
 2026-09-21 10:11:29 -07:00
kerry-berri
2b7fe878ec
Merge pull request #42253 from BerriAI/litellm-providers/price-sync-openrouter 
chore(prices): sync OpenRouter prices: 6 models, 1 new
 2026-09-21 10:10:14 -07:00
kerry-berri
d579595175
Merge pull request #42258 from BerriAI/litellm-providers/price-sync-together-ai 
chore(prices): sync Together AI prices: 2 models
 2026-09-21 10:09:50 -07:00
tin-berri
fe34fe6047
Merge pull request #42252 from BerriAI/litellm_heuristic_v2_success_threshold 
feat(auto-router): configure heuristic v2 success threshold
 2026-09-21 10:06:09 -07:00
yuneng-jiang
da76ba83ad
Merge pull request #42105 from BerriAI/litellm_flip_v2_migration_resolver_default 
feat(proxy): default to the v2 migration resolver
 2026-09-21 10:05:59 -07:00
berriai-litellm-provider-info-sync[bot]
43b81e448d
chore(prices): sync OpenRouter prices: 6 models, 1 new 
openrouter/~deepseek/deepseek-pro-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/~x-ai/grok-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, input_cost_per_token_above_200k_tokens, output_cost_per_token_above_200k_tokens, cache_read_input_token_cost_above_200k_tokens
openrouter/anthropic/claude-sonnet-4: max_input_tokens
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/x-ai/grok-4.7: max_tokens, supports_vision, max_input_tokens, max_output_tokens, supports_pdf_input, supports_reasoning, supports_web_search, supports_audio_input, supports_tool_choice, supports_prompt_caching, supports_response_schema, supports_function_calling, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, input_cost_per_token_above_200k_tokens, output_cost_per_token_above_200k_tokens, cache_read_input_token_cost_above_200k_tokens
 2026-09-21 17:01:42 +00:00
berriai-litellm-provider-info-sync[bot]
3d15f08fda
chore(prices): sync Together AI prices: 2 models 
together_ai/Qwen/Qwen3.7-Max: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
together_ai/Qwen/Qwen3.8-Flash: input_cost_per_token, output_cost_per_token
 2026-09-21 17:01:30 +00:00
yuneng-jiang
27797923a3
Merge pull request #42160 from BerriAI/litellm_migrate_tests_p17 
test(a2a): migrate a2a_protocol legacy tests to tests/unit (wave 3 phase 17)
 2026-09-21 09:19:29 -07:00
yuneng
58729ac69f test(a2a): sort imports in merged bedrock agentcore test 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 16:10:40 +00:00
yuneng
46383eec3c Merge remote-tracking branch 'origin/main' into litellm_migrate_tests_p17 2026-09-21 16:09:42 +00:00
kerry-berri
aa2219d466
Merge pull request #42250 from BerriAI/litellm-providers/price-sync-aws-bedrock 
chore(prices): sync AWS Bedrock prices: 25 models [enrichment failed: AWS Bedrock, 66 held]
 2026-09-21 08:59:45 -07:00
kerry-berri
37fb6e72d4
Merge pull request #42249 from BerriAI/litellm-providers/price-sync-azure 
chore(prices): sync Azure prices: 1 model, 1 deprecated
 2026-09-21 08:59:08 -07:00
Tin Chi Lo
a233ba910d feat(auto-router): configure heuristic v2 success threshold 2026-09-21 08:53:13 -07:00
kerry-berri
e270ba5aa6
Merge pull request #42251 from BerriAI/litellm-providers/price-sync-openrouter 
chore(prices): sync OpenRouter prices: 3 models
 2026-09-21 08:41:41 -07:00
berriai-litellm-provider-info-sync[bot]
739227fefc
chore(prices): sync OpenRouter prices: 3 models 
openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
 2026-09-21 15:31:20 +00:00
berriai-litellm-provider-info-sync[bot]
ade39978a9
chore(prices): sync AWS Bedrock prices: 25 models [enrichment failed: AWS Bedrock, 66 held] 
anthropic.claude-fable-5: 
anthropic.claude-fable-5-1: 
anthropic.claude-opus-4-7: 
anthropic.claude-opus-4-8: 
anthropic.claude-opus-5: 
anthropic.claude-sonnet-4-6: 
anthropic.claude-sonnet-5: 
global.anthropic.claude-fable-5: 
global.anthropic.claude-fable-5-1: 
global.anthropic.claude-opus-4-7: 
global.anthropic.claude-opus-4-8: 
global.anthropic.claude-opus-5: 
global.anthropic.claude-sonnet-4-6: 
global.anthropic.claude-sonnet-5: 
us-gov.anthropic.claude-fable-5-1: 
us-gov.anthropic.claude-opus-4-8: 
us-gov.anthropic.claude-opus-5: 
us-gov.anthropic.claude-sonnet-5: 
us.anthropic.claude-fable-5: 
us.anthropic.claude-fable-5-1: 
us.anthropic.claude-opus-4-7: 
us.anthropic.claude-opus-4-8: 
us.anthropic.claude-opus-5: 
us.anthropic.claude-sonnet-4-6: 
us.anthropic.claude-sonnet-5:
 2026-09-21 15:31:16 +00:00
berriai-litellm-provider-info-sync[bot]
a3dcec463b
chore(prices): sync Azure prices: 1 model, 1 deprecated 
azure_ai/MAI-Image-2.5-Pro: deprecation_date
 2026-09-21 15:31:08 +00:00
kerry-berri
0e252c2de3
Merge pull request #42246 from BerriAI/litellm-providers/price-sync-openrouter 
chore(prices): sync OpenRouter prices: 4 models
 2026-09-21 08:22:06 -07:00
kerry
97fc8220df fix(prices): align deepseek-v4-pro-0813 off-peak and cache-hit rates with the base cache read rate 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 15:14:19 +00:00
Yassin Kortam
e912ebe999
Merge pull request #42152 from BerriAI/litellm_claude_code_safeguards_passthrough 
fix(anthropic): forward safeguards and anthropic-beta unchanged on native /v1/messages
 2026-09-21 10:12:44 -05:00
kerry-berri
701c2b7256
Merge pull request #34941 from BerriAI/litellm_azure_ai_mai_image_2_5_pro 2026-09-21 08:07:36 -07:00
berriai-litellm-provider-info-sync[bot]
33e64e53f9
chore(prices): sync OpenRouter prices: 4 models 
openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
 2026-09-21 15:00:53 +00:00
Yassin Kortam
1ac4d7ae04 fix(anthropic): type safeguards and safeguard_results as the arrays Anthropic sends 
Driving a real Claude Code 2.1.278 through the proxy, and a direct call to
api.anthropic.com, both show these two fields are JSON arrays on the wire rather
than objects. The request carries safeguards as
[{"type": "dangerous_tool_use", "classifier_context": {...}}] under beta
dangerous-tool-use-2026-09-03, and the 200 comes back with safeguard_results as
[{"type": "dangerous_tool_use", "status": {"type": "available", "tool_uses": {...}}}].

No runtime change: the request filter matches on TypedDict keys and never inspects
the value. The test fixtures move to the captured shapes so the regression tests
pin what the client and the provider actually exchange.
 2026-09-21 09:55:09 -05:00
Yassin Kortam
32133a329c
Merge pull request #42239 from BerriAI/litellm_agentcore_a2a_message_stream 
fix(a2a): send message/stream for Bedrock AgentCore streaming requests
 2026-09-21 09:53:41 -05:00
kerry-berri
f008c018a3
Merge pull request #42243 from BerriAI/litellm-providers/price-sync-openrouter 
chore(prices): sync OpenRouter prices: 4 models
 2026-09-21 07:49:01 -07:00
kerry
7b2d3b36b6 fix(prices): align deepseek-v4-pro-0813 cache hit cost with cache read cost 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 14:40:46 +00:00
berriai-litellm-provider-info-sync[bot]
346ad002c8
chore(prices): sync OpenRouter prices: 4 models 
openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/meta-llama/llama-3.1-70b-instruct: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token
 2026-09-21 14:30:57 +00:00
kerry-berri
0d45883312
Merge pull request #42240 from BerriAI/litellm-providers/price-sync-openrouter 
chore(prices): sync OpenRouter prices: 1 model
 2026-09-21 07:09:26 -07:00
berriai-litellm-provider-info-sync[bot]
18ca95c3a7
chore(prices): sync OpenRouter prices: 1 model 
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
 2026-09-21 14:00:51 +00:00
yassin
6786eb0131 fix(a2a): send message/stream for Bedrock AgentCore streaming requests 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 13:39:32 +00:00
kerry-berri
dfbdcf1c9d
Merge pull request #42234 from BerriAI/litellm-providers/price-sync-openrouter 
chore(prices): sync OpenRouter prices: 1 model
 2026-09-21 06:39:30 -07:00
Yassin Kortam
def37c6532
Merge pull request #42097 from BerriAI/litellm_budget_exceeded_422 
fix(proxy): return 422 instead of 429 for BudgetExceededError
 2026-09-21 08:35:30 -05:00
Yassin Kortam
502de6bed9
Merge pull request #42207 from BerriAI/litellm_helm_componentized_replica_count 
fix(helm): render a fixed replicaCount on componentized deployments when HPA is disabled
 2026-09-21 08:31:06 -05:00
berriai-litellm-provider-info-sync[bot]
6db2bce43c
chore(prices): sync OpenRouter prices: 1 model 
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
 2026-09-21 13:30:42 +00:00
Devin AI
2888b4f5f4 fix(bedrock): whitelist regional qwen3-next keys for converse routing check 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 13:30:35 +00:00
Devin AI
d9a97d74db fix(model_prices): add groq qwen3.6-27b deprecation date and bedrock qwen3-next regional pricing 
Groq lists qwen/qwen3.6-27b for shutdown on 2026-09-14. Adds the six regional
Bedrock qwen.qwen3-next-80b-a3b entries priced per AWS's published regional
rates (absorbs #42191) with a regression test that the regional entry is used
instead of the US rate

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 13:21:50 +00:00
Devin AI
30adc1b2b9 Merge remote-tracking branch 'origin/main' into litellm_azure_ai_mai_image_2_5_pro 2026-09-21 13:20:20 +00:00
kerry-berri
0c01d297b9
Merge pull request #42227 from BerriAI/litellm-providers/price-sync-openrouter 
chore(prices): sync OpenRouter prices: 2 models
 2026-09-21 06:10:10 -07:00
Mateo Wang
0c1dd2cee4
Merge pull request #42220 from BerriAI/litellm_any_sweep_20260921 
refactor(types): replace Any with proven types in 32 files
 2026-09-21 06:07:47 -07:00
berriai-litellm-provider-info-sync[bot]
85e72a2e2f
chore(prices): sync OpenRouter prices: 2 models 
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
 2026-09-21 13:00:50 +00:00
Devin AI
8795be0a65 refactor(types): replace Any with proven types in 32 files 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-21 10:51:46 +00:00
Mateo Wang
1cac8bd9ab
Merge pull request #42193 from BerriAI/litellm_responses_bridge_safety_identifier 
fix(responses): forward safety_identifier through the chat completion bridge
 2026-09-21 01:36:26 -07:00