53255 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
ryan	ec55ab1ddb	refactor(auth): use Annotated dependency in change_password to satisfy strict gate ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:57:48 +00:00
Yujong Lee	a7bc8e373e	feat(cache): project Python backend configuration	2026-09-21 11:56:04 -07:00
mateo-berri	5ea4fe620f	test(router): give each prompt caching check test a fresh callback registry	2026-09-21 11:55:58 -07:00
moe-berri	a83773cfa5	Merge pull request #41886 from BerriAI/litellm_jev_autorouter_launch_1789767495 ... feat(auto-router): add JEV classifier alongside LLM classifier	2026-09-21 11:55:44 -07:00
mateo-berri	f549c87091	Merge branch 'main' into litellm_prompt_caching_affinity_lookback	2026-09-21 11:55:40 -07:00
Mateo Wang	7cb884cd31	Merge pull request #42120 from BerriAI/litellm_cadence_58065d4_google_genai_proxy_master_key ... test(google): boot the unified Google proxy fixture with a real master key	2026-09-21 11:54:03 -07:00
ryan	6bfbc7dba4	test(auth): pass throttle to authenticate_user in reset-required tests ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:53:39 +00:00
kerry-berri	8ee8613b07	Merge pull request #42271 from BerriAI/litellm_bedrock_kimi_k3_us_cris ... feat(bedrock): add us.moonshotai.kimi-k3 pricing and fill the global Kimi K3 entry	2026-09-21 11:51:54 -07:00
ryan	07c9355f4e	fix(ui): regenerate schema.d.ts against main ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:49:31 +00:00
ryan	3fe405a5cc	feat(auth): breached password detection, self-service change-password and forced password reset ... Cherry-pick of merge commit b3882d8e43 (PRs #39321, #39562, #40107), which landed on litellm_internal_staging instead of main. Co-authored-by: ojensen-berri <ojensen@berri.ai> Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:48:35 +00:00
kerry-berri	12379aa1e3	Merge pull request #42095 from BerriAI/litellm_fal_gpt_image_25_flux_dev_edits ... feat(fal_ai): add gpt-image-2.5 flare/sunburst, flux/dev and image edits	2026-09-21 11:45:45 -07:00
kerry-berri	24f0f373fc	Merge pull request #42270 from BerriAI/litellm-providers/price-sync-openrouter ... chore(prices): sync OpenRouter prices: 6 models	2026-09-21 11:41:51 -07:00
kerry-berri	9b65ec206a	Merge pull request #42269 from BerriAI/litellm-providers/price-sync-aws-bedrock ... chore(prices): sync AWS Bedrock prices: 3 models [enrichment failed: AWS Bedrock, 32 held]	2026-09-21 11:41:45 -07:00
Devin AI	a3f1956090	test(e2e): client disconnect must not bench the Azure deployment it cancelled ... Live proxy with cancel_on_disconnect, two-deployment group, generic allowed_fails=0, red at the pre-fix handler and green with the bare raise Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:39:37 +00:00
mateo-berri	e51ccbc759	fix(bedrock): forward anthropic-beta headers verbatim on the Claude platform messages path	2026-09-21 11:39:26 -07:00
mateo-berri	f567fe230e	fix: reserve cap slots for direct marks on /v1/messages when extra_body unmarks them	2026-09-21 11:39:25 -07:00
Mateo Wang	4b2e96a5f5	Merge pull request #42143 from BerriAI/litellm_e2e_changed_keep_pytest_log ... ci(e2e): fix the stage-mirror batch reds and keep a redacted pytest log	2026-09-21 11:39:25 -07:00
Joshua Valluru	1499d84f5a	fix(mcp): paginate optional discovery lists	2026-09-21 11:37:55 -07:00
Devin AI	b090f765d5	Merge origin/main into devin_ai_fix_azure_cancellederror_35329 ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:36:06 +00:00
mateo-berri	4c50710c02	Merge branch 'main' into claude/e2e-tests-custom-endpoints-qxoi1o ... Resolves the six conflicts main accumulated against the SDK migration. endpoints_client.py stays deleted (main only added the safety_identifier kwarg to it), and its two new importers move onto the SDK clients: the Bedrock safety_identifier forwarding test in test_responses_e2e.py now sends its /v1/responses leg through the OpenAI SDK and its chat leg through ProxyClient.chat, and test_messages_azure_foundry_e2e.py drops the x-litellm-rust header check together with EXPECT_RUST, which main removed from e2e_config in a84f68b6e3. proxy_client.py keeps both the rerank and router-settings model imports. uv.lock is main's lock plus the anthropic e2e-dev entry, and the pricing JSONs are taken verbatim from main since this PR never meant to change them.	2026-09-21 11:34:21 -07:00
kerry	29837b422e	feat(bedrock): add us.moonshotai.kimi-k3 pricing and fill the global Kimi K3 entry ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:32:55 +00:00
berriai-litellm-provider-info-sync[bot]	9f041f3ea3	chore(prices): sync OpenRouter prices: 6 models ... openrouter/~deepseek/deepseek-pro-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/~deepseek/deepseek-v4-flash-latest: output_cost_per_token openrouter/deepseek/deepseek-v4-flash-0731: output_cost_per_token openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/deepseek/deepseek-v4-pro-0813: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/nvidia/nemotron-3-nano-30b-a3b: supports_prompt_caching, input_cost_per_token, output_cost_per_token	2026-09-21 18:31:34 +00:00
berriai-litellm-provider-info-sync[bot]	950f28fa63	chore(prices): sync AWS Bedrock prices: 3 models [enrichment failed: AWS Bedrock, 32 held] ... google.gemma-3-27b-it: max_tokens, max_output_tokens, supports_audio_input, supports_response_schema, supports_function_calling mistral.ministral-3-3b-instruct: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema nvidia.nemotron-nano-12b-v2: max_tokens, max_output_tokens, supports_audio_input, supports_response_schema, supports_function_calling	2026-09-21 18:31:32 +00:00
Tin Chi Lo	71465fc2f7	chore(router): resolve merge conflict with main	2026-09-21 11:29:48 -07:00
Moe Khalil	83ec5d6101	fix(auto-router): skip JEV for encrypted delegated tasks ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:29:21 +00:00
mateo-berri	79d1af9d3c	chore: merge origin/main to pick up the pre-call check test move	2026-09-21 11:28:04 -07:00
Yujong Lee	22995d1575	fix(cache): remove redundant source comments	2026-09-21 11:23:47 -07:00
Yujong Lee	1b6b704ddd	refactor(cache): keep native foundation isolated	2026-09-21 11:15:44 -07:00
mateo-berri	c1ba76154e	fix(litellm): pass a flat Responses-style function tool through the chat bridge unchanged	2026-09-21 11:14:59 -07:00
yucheng	1f1b61173d	fix(otel v2): map OCR page markdown onto the generation output ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:10:41 +00:00
kerry-berri	36b8be7d81	Merge pull request #42264 from BerriAI/litellm_add_grok_4_7 ... feat(xai): add grok-4.7 to the cost map	2026-09-21 11:10:37 -07:00
kerry-berri	f1362193f3	Merge pull request #42265 from BerriAI/litellm-providers/price-sync-openrouter ... chore(prices): sync OpenRouter prices: 4 models	2026-09-21 11:10:05 -07:00
yucheng	3e2d03297f	refactor(bedrock): build batch output config with explicit returns ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 18:04:34 +00:00
mateo-berri	c8e42c2ac3	ci(e2e): give string_leaves a single trailing return	2026-09-21 11:02:28 -07:00
berriai-litellm-provider-info-sync[bot]	3cc0948dc0	chore(prices): sync OpenRouter prices: 4 models ... openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/~z-ai/glm-flash-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/z-ai/glm-5.3-flash: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost	2026-09-21 18:01:32 +00:00
mateo-berri	5e4ff0153c	Merge branch 'main' into devin_ai_fix_azure_cancellederror_35329	2026-09-21 11:01:06 -07:00
kerry	795239de20	fix: add xai/grok-4.7 to model cost map backup file ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 17:59:09 +00:00
kerry	38fc7d6dca	feat(xai): add grok-4.7 to the cost map ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 17:57:32 +00:00
kerry	4595d18047	Merge remote-tracking branch 'origin/main' into pr40429	2026-09-21 17:42:28 +00:00
ryan-crabbe-berri	cc1a3157d3	Merge pull request #42121 from BerriAI/litellm_utils_model_info_lookup ... feat(proxy): add GET /utils/model_info to look up cost map info for unregistered models	2026-09-21 10:42:28 -07:00
kerry	052d93d6dd	test(integration): assert full fal image payloads and use existing catalog rows ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 17:42:02 +00:00
kerry-berri	1fbfb460e1	Merge pull request #42261 from BerriAI/litellm-providers/price-sync-openrouter ... chore(prices): sync OpenRouter prices: 7 models	2026-09-21 10:40:56 -07:00
kerry-berri	01bdda72ba	Merge pull request #42254 from BerriAI/litellm-providers/price-sync-aws-bedrock ... chore(prices): sync AWS Bedrock prices: 13 models, 1 new [1 with gaps, enrichment failed: AWS Bedrock, 38 held]	2026-09-21 10:40:33 -07:00
kerry	7510697355	test(integration): fal image generation and edit wire contracts ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 17:39:53 +00:00
yucheng	e647255909	fix(policy_engine): resolve policies once and apply fallback semantics in get_matching_policies ... Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 17:36:03 +00:00
ryan-crabbe-berri	5573265013	Merge pull request #41906 from BerriAI/litellm_team_member_budget_source_reset ... feat(team): show whether a member follows the team default budget and allow resetting to it	2026-09-21 10:34:08 -07:00
berriai-litellm-provider-info-sync[bot]	00b298a36d	chore(prices): sync AWS Bedrock prices: 13 models, 1 new [1 with gaps, enrichment failed: AWS Bedrock, 38 held] ... deepseek.v3.2: max_tokens, supports_vision, max_input_tokens, max_output_tokens, supports_audio_input, supports_response_schema global.moonshotai.kimi-k3: supports_vision, max_input_tokens, supports_audio_input, supports_response_schema, supports_function_calling, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, cache_creation_input_token_cost, supports_tool_choice, supports_prompt_caching google.gemma-3-12b-it: max_tokens, max_output_tokens, supports_audio_input, supports_response_schema, supports_function_calling google.gemma-3-4b-it: max_tokens, max_output_tokens, supports_audio_input, supports_function_calling mistral.devstral-2-123b: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema mistral.magistral-small-2509: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema mistral.ministral-3-14b-instruct: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema mistral.ministral-3-8b-instruct: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema mistral.mistral-large-3-675b-instruct: max_tokens, supports_vision, max_input_tokens, max_output_tokens, supports_audio_input, supports_response_schema moonshotai.kimi-k2.5: max_tokens, max_input_tokens, max_output_tokens, supports_audio_input, supports_response_schema nvidia.nemotron-nano-3-30b: max_tokens, supports_vision, max_input_tokens, max_output_tokens, supports_audio_input, supports_response_schema nvidia.nemotron-nano-9b-v2: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema, supports_function_calling nvidia.nemotron-super-3-120b: max_tokens, supports_vision, max_output_tokens, supports_audio_input, supports_response_schema	2026-09-21 17:31:49 +00:00
berriai-litellm-provider-info-sync[bot]	bed94a48d9	chore(prices): sync OpenRouter prices: 7 models ... openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/~moonshotai/kimi-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing openrouter/ibm-granite/granite-4.2-8b: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/moonshotai/kimi-k3: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/qwen/qwen3.8-27b: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost	2026-09-21 17:31:40 +00:00
Yujong Lee	595711829a	wip	2026-09-21 10:30:42 -07:00
yucheng	d56479767e	fix(bedrock): send s3BucketOwner on batch input and output data config ... Resolve s3_bucket_owner from litellm_params, then optional_params, then AWS_S3_BUCKET_OWNER and emit it on both S3 data configs so cross-account batch buckets pass Bedrock ownership validation. Omitted when unset Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-21 17:27:12 +00:00