52992 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
kerry-berri	24f0f373fc	Merge pull request #42270 from BerriAI/litellm-providers/price-sync-openrouter ... chore(prices): sync OpenRouter prices: 6 models	2026-09-21 11:41:51 -07:00
kerry-berri	9b65ec206a	Merge pull request #42269 from BerriAI/litellm-providers/price-sync-aws-bedrock ... chore(prices): sync AWS Bedrock prices: 3 models [enrichment failed: AWS Bedrock, 32 held]	2026-09-21 11:41:45 -07:00
Devin AI	a3f1956090	test(e2e): client disconnect must not bench the Azure deployment it cancelled ... Live proxy with cancel_on_disconnect, two-deployment group, generic allowed_fails=0, red at the pre-fix handler and green with the bare raise Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:39:37 +00:00
mateo-berri	e51ccbc759	fix(bedrock): forward anthropic-beta headers verbatim on the Claude platform messages path	2026-09-21 11:39:26 -07:00
mateo-berri	f567fe230e	fix: reserve cap slots for direct marks on /v1/messages when extra_body unmarks them	2026-09-21 11:39:25 -07:00
Mateo Wang	4b2e96a5f5	Merge pull request #42143 from BerriAI/litellm_e2e_changed_keep_pytest_log ... ci(e2e): fix the stage-mirror batch reds and keep a redacted pytest log	2026-09-21 11:39:25 -07:00
Joshua Valluru	1499d84f5a	fix(mcp): paginate optional discovery lists	2026-09-21 11:37:55 -07:00
Devin AI	b090f765d5	Merge origin/main into devin_ai_fix_azure_cancellederror_35329 ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:36:06 +00:00
mateo-berri	4c50710c02	Merge branch 'main' into claude/e2e-tests-custom-endpoints-qxoi1o ... Resolves the six conflicts main accumulated against the SDK migration. endpoints_client.py stays deleted (main only added the safety_identifier kwarg to it), and its two new importers move onto the SDK clients: the Bedrock safety_identifier forwarding test in test_responses_e2e.py now sends its /v1/responses leg through the OpenAI SDK and its chat leg through ProxyClient.chat, and test_messages_azure_foundry_e2e.py drops the x-litellm-rust header check together with EXPECT_RUST, which main removed from e2e_config in a84f68b6e3. proxy_client.py keeps both the rerank and router-settings model imports. uv.lock is main's lock plus the anthropic e2e-dev entry, and the pricing JSONs are taken verbatim from main since this PR never meant to change them.	2026-09-21 11:34:21 -07:00
kerry	29837b422e	feat(bedrock): add us.moonshotai.kimi-k3 pricing and fill the global Kimi K3 entry ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:32:55 +00:00
berriai-litellm-provider-info-sync[bot]	9f041f3ea3	chore(prices): sync OpenRouter prices: 6 models ... openrouter/~deepseek/deepseek-pro-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/~deepseek/deepseek-v4-flash-latest: output_cost_per_token openrouter/deepseek/deepseek-v4-flash-0731: output_cost_per_token openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/deepseek/deepseek-v4-pro-0813: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/nvidia/nemotron-3-nano-30b-a3b: supports_prompt_caching, input_cost_per_token, output_cost_per_token	2026-09-21 18:31:34 +00:00
berriai-litellm-provider-info-sync[bot]	950f28fa63	chore(prices): sync AWS Bedrock prices: 3 models [enrichment failed: AWS Bedrock, 32 held] ... google.gemma-3-27b-it: max_tokens, max_output_tokens, supports_audio_input, supports_response_schema, supports_function_calling mistral.ministral-3-3b-instruct: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema nvidia.nemotron-nano-12b-v2: max_tokens, max_output_tokens, supports_audio_input, supports_response_schema, supports_function_calling	2026-09-21 18:31:32 +00:00
Tin Chi Lo	71465fc2f7	chore(router): resolve merge conflict with main	2026-09-21 11:29:48 -07:00
Moe Khalil	83ec5d6101	fix(auto-router): skip JEV for encrypted delegated tasks ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:29:21 +00:00
mateo-berri	79d1af9d3c	chore: merge origin/main to pick up the pre-call check test move	2026-09-21 11:28:04 -07:00
Yujong Lee	22995d1575	fix(cache): remove redundant source comments	2026-09-21 11:23:47 -07:00
Yujong Lee	1b6b704ddd	refactor(cache): keep native foundation isolated	2026-09-21 11:15:44 -07:00
mateo-berri	c1ba76154e	fix(litellm): pass a flat Responses-style function tool through the chat bridge unchanged	2026-09-21 11:14:59 -07:00
yucheng	1f1b61173d	fix(otel v2): map OCR page markdown onto the generation output ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:10:41 +00:00
kerry-berri	36b8be7d81	Merge pull request #42264 from BerriAI/litellm_add_grok_4_7 ... feat(xai): add grok-4.7 to the cost map	2026-09-21 11:10:37 -07:00
kerry-berri	f1362193f3	Merge pull request #42265 from BerriAI/litellm-providers/price-sync-openrouter ... chore(prices): sync OpenRouter prices: 4 models	2026-09-21 11:10:05 -07:00
yucheng	3e2d03297f	refactor(bedrock): build batch output config with explicit returns ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:04:34 +00:00
mateo-berri	c8e42c2ac3	ci(e2e): give string_leaves a single trailing return	2026-09-21 11:02:28 -07:00
berriai-litellm-provider-info-sync[bot]	3cc0948dc0	chore(prices): sync OpenRouter prices: 4 models ... openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/~z-ai/glm-flash-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/z-ai/glm-5.3-flash: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost	2026-09-21 18:01:32 +00:00
mateo-berri	5e4ff0153c	Merge branch 'main' into devin_ai_fix_azure_cancellederror_35329	2026-09-21 11:01:06 -07:00
kerry	795239de20	fix: add xai/grok-4.7 to model cost map backup file ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 17:59:09 +00:00
kerry	38fc7d6dca	feat(xai): add grok-4.7 to the cost map ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 17:57:32 +00:00
kerry	4595d18047	Merge remote-tracking branch 'origin/main' into pr40429	2026-09-21 17:42:28 +00:00
ryan-crabbe-berri	cc1a3157d3	Merge pull request #42121 from BerriAI/litellm_utils_model_info_lookup ... feat(proxy): add GET /utils/model_info to look up cost map info for unregistered models	2026-09-21 10:42:28 -07:00
kerry	052d93d6dd	test(integration): assert full fal image payloads and use existing catalog rows ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 17:42:02 +00:00
kerry-berri	1fbfb460e1	Merge pull request #42261 from BerriAI/litellm-providers/price-sync-openrouter ... chore(prices): sync OpenRouter prices: 7 models	2026-09-21 10:40:56 -07:00
kerry-berri	01bdda72ba	Merge pull request #42254 from BerriAI/litellm-providers/price-sync-aws-bedrock ... chore(prices): sync AWS Bedrock prices: 13 models, 1 new [1 with gaps, enrichment failed: AWS Bedrock, 38 held]	2026-09-21 10:40:33 -07:00
kerry	7510697355	test(integration): fal image generation and edit wire contracts ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 17:39:53 +00:00
yucheng	e647255909	fix(policy_engine): resolve policies once and apply fallback semantics in get_matching_policies ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 17:36:03 +00:00
ryan-crabbe-berri	5573265013	Merge pull request #41906 from BerriAI/litellm_team_member_budget_source_reset ... feat(team): show whether a member follows the team default budget and allow resetting to it	2026-09-21 10:34:08 -07:00
berriai-litellm-provider-info-sync[bot]	00b298a36d	chore(prices): sync AWS Bedrock prices: 13 models, 1 new [1 with gaps, enrichment failed: AWS Bedrock, 38 held] ... deepseek.v3.2: max_tokens, supports_vision, max_input_tokens, max_output_tokens, supports_audio_input, supports_response_schema global.moonshotai.kimi-k3: supports_vision, max_input_tokens, supports_audio_input, supports_response_schema, supports_function_calling, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, cache_creation_input_token_cost, supports_tool_choice, supports_prompt_caching google.gemma-3-12b-it: max_tokens, max_output_tokens, supports_audio_input, supports_response_schema, supports_function_calling google.gemma-3-4b-it: max_tokens, max_output_tokens, supports_audio_input, supports_function_calling mistral.devstral-2-123b: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema mistral.magistral-small-2509: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema mistral.ministral-3-14b-instruct: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema mistral.ministral-3-8b-instruct: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema mistral.mistral-large-3-675b-instruct: max_tokens, supports_vision, max_input_tokens, max_output_tokens, supports_audio_input, supports_response_schema moonshotai.kimi-k2.5: max_tokens, max_input_tokens, max_output_tokens, supports_audio_input, supports_response_schema nvidia.nemotron-nano-3-30b: max_tokens, supports_vision, max_input_tokens, max_output_tokens, supports_audio_input, supports_response_schema nvidia.nemotron-nano-9b-v2: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema, supports_function_calling nvidia.nemotron-super-3-120b: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema	2026-09-21 17:31:49 +00:00
berriai-litellm-provider-info-sync[bot]	bed94a48d9	chore(prices): sync OpenRouter prices: 7 models ... openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/~moonshotai/kimi-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/ibm-granite/granite-4.2-8b: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/moonshotai/kimi-k3: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/qwen/qwen3.8-27b: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost	2026-09-21 17:31:40 +00:00
Yujong Lee	595711829a	wip	2026-09-21 10:30:42 -07:00
yucheng	d56479767e	fix(bedrock): send s3BucketOwner on batch input and output data config ... Resolve s3_bucket_owner from litellm_params, then optional_params, then AWS_S3_BUCKET_OWNER and emit it on both S3 data configs so cross-account batch buckets pass Bedrock ownership validation. Omitted when unset Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 17:27:12 +00:00
Yujong Lee	dc5f0c58a4	feat(cache): add native backend operation primitives	2026-09-21 10:21:54 -07:00
Moe Khalil	bb46e8b774	chore(auto-router): merge main and preserve JEV configuration ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 17:16:18 +00:00
yucheng-berri	51ae7ab1fd	Merge pull request #41588 from BerriAI/litellm_ui_session_personal_key_budget_ceiling ... * fix(key_generate): use user's budget for UI session personal keys Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * Update litellm/proxy/management_endpoints/key_management_endpoints.py Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> * fix(user_update): evict cached user on max_budget change so the personal key ceiling refreshes on every worker Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> --------- Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: jesus-berri <jesus@berri.ai> Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Co-authored-by: yucheng <yucheng@berri.ai>	2026-09-21 10:11:29 -07:00
kerry-berri	2b7fe878ec	Merge pull request #42253 from BerriAI/litellm-providers/price-sync-openrouter ... chore(prices): sync OpenRouter prices: 6 models, 1 new	2026-09-21 10:10:14 -07:00
kerry-berri	d579595175	Merge pull request #42258 from BerriAI/litellm-providers/price-sync-together-ai ... chore(prices): sync Together AI prices: 2 models	2026-09-21 10:09:50 -07:00
tin-berri	fe34fe6047	Merge pull request #42252 from BerriAI/litellm_heuristic_v2_success_threshold ... feat(auto-router): configure heuristic v2 success threshold	2026-09-21 10:06:09 -07:00
yuneng-jiang	da76ba83ad	Merge pull request #42105 from BerriAI/litellm_flip_v2_migration_resolver_default ... feat(proxy): default to the v2 migration resolver	2026-09-21 10:05:59 -07:00
berriai-litellm-provider-info-sync[bot]	43b81e448d	chore(prices): sync OpenRouter prices: 6 models, 1 new ... openrouter/~deepseek/deepseek-pro-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/~x-ai/grok-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, input_cost_per_token_above_200k_tokens, output_cost_per_token_above_200k_tokens, cache_read_input_token_cost_above_200k_tokens openrouter/anthropic/claude-sonnet-4: max_input_tokens openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/deepseek/deepseek-v4-pro-0813: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/x-ai/grok-4.7: max_tokens, supports_vision, max_input_tokens, max_output_tokens, supports_pdf_input, supports_reasoning, supports_web_search, supports_audio_input, supports_tool_choice, supports_prompt_caching, supports_response_schema, supports_function_calling, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, input_cost_per_token_above_200k_tokens, output_cost_per_token_above_200k_tokens, cache_read_input_token_cost_above_200k_tokens	2026-09-21 17:01:42 +00:00
berriai-litellm-provider-info-sync[bot]	3d15f08fda	chore(prices): sync Together AI prices: 2 models ... together_ai/Qwen/Qwen3.7-Max: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost together_ai/Qwen/Qwen3.8-Flash: input_cost_per_token, output_cost_per_token	2026-09-21 17:01:30 +00:00
Yujong Lee	ef14fdaf33	fix(cache): harden native foundation parity	2026-09-21 09:53:41 -07:00
yuneng-jiang	27797923a3	Merge pull request #42160 from BerriAI/litellm_migrate_tests_p17 ... test(a2a): migrate a2a_protocol legacy tests to tests/unit (wave 3 phase 17)	2026-09-21 09:19:29 -07:00