litellm

mirror of https://github.com/BerriAI/litellm.git synced 2026-09-24 00:52:24 +00:00

Author	SHA1	Message	Date
Mateo Wang	5417abd586	Merge pull request #42011 from BerriAI/litellm_scrub_default_master_key docs: stop advertising sk-1234 as the master key in shipped configs and examples	2026-09-19 19:05:31 -07:00
Mateo Wang	b6dd3d932c	Merge pull request #42019 from BerriAI/litellm_master_key_boot_enforcement feat(proxy)!: refuse to start with an unset, empty, or publicly known master key	2026-09-19 19:04:02 -07:00
ryan-crabbe-berri	ecf17513fb	refactor(proxy): rename the local development override to dangerously_permit_weak_or_unset_master_key so the name says exactly what it permits	2026-09-19 18:53:14 -07:00
joshua-berri	daecea3eb8	Merge pull request #42050 from BerriAI/litellm_mcp_scoped_regressions_4506_rework test(mcp): restore scoped execution and credential isolation regressions	2026-09-20 01:29:44 +00:00
Mateo Wang	93e39d5042	Merge pull request #42062 from BerriAI/litellm_pr38499_batch_retrieve_model_group fix(router): stamp model_group when retrieving a batch, so batch tokens are attributable (internal copy of #38499)	2026-09-19 18:23:06 -07:00
Yassin Kortam	56b3422cc2	Merge pull request #42046 from BerriAI/litellm_cost_poll_404_no_cooldown	2026-09-19 18:20:27 -07:00
Yassin Kortam	755f5c535d	Merge pull request #41994 from BerriAI/litellm_redis_spend_requeue_safety	2026-09-19 18:19:57 -07:00
yuneng-jiang	fba00f5084	Merge pull request #42054 from BerriAI/litellm_/release-ui-build-95a688 chore: rebuild Admin UI bundle from main (build kXnLzJ6ylsRPmgSkCkCKM)	2026-09-19 18:19:33 -07:00
Joshua Valluru	fdc4ad54c5	docs(mcp): remove duplicate regression coverage inventory	2026-09-19 18:18:37 -07:00
kerry-berri	faa2a71fba	Merge pull request #42063 from BerriAI/litellm-providers/price-sync-openrouter chore(prices): sync OpenRouter prices: 2 models	2026-09-19 18:13:28 -07:00
ryan-crabbe-berri	99f99cfb46	fix(proxy): stop the boot when the requested master key migration fails, unless allow_requests_on_db_unavailable tolerates the outage	2026-09-19 18:10:52 -07:00
berriai-litellm-provider-info-sync[bot]	b652aaad4a	chore(prices): sync OpenRouter prices: 2 models openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/z-ai/glm-5.3: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost	2026-09-20 01:00:52 +00:00
Yuneng Jiang	98a3f45d21	chore: update Next.js build artifacts (2026-09-20 00:59 UTC, node v24.19.0)	2026-09-19 17:59:07 -07:00
ryan-crabbe-berri	a6c51ba3de	fix(proxy): never treat plaintext that base64-decodes to nothing as a ciphertext during the master key migration A string such as "*" or "..." has no base64 characters, so it decoded to no bytes and read as an empty plaintext under any key. The migration would have counted it and overwritten it with a ciphertext of the empty string. Also read from the writer database instead of a read replica, report a database error during the migration instead of crashing the boot, skip columns the connected schema lacks across every schema on the search path, cap the JSON walk depth for the recursion detector, and move the boot wiring into one tested function.	2026-09-19 17:53:17 -07:00
kerry-berri	d1773d96e9	Merge pull request #42058 from BerriAI/litellm-providers/price-sync-openrouter chore(prices): sync OpenRouter prices: 5 models	2026-09-19 17:41:47 -07:00
mateo-berri	867a4df347	fix(proxy): claim a finished batch's per-model budget charge atomically A finished batch reports its whole cost on every poll. The charge-once marker is now taken with one atomic increment on the shared cache, so two workers polling the same batch at once cannot both charge it, and the marker's TTL is refreshed on every poll so a batch polled within every budget window is never charged again after the marker's first expiry.	2026-09-19 17:41:19 -07:00
yucheng-berri	82ddab2405	Merge pull request #41840 from BerriAI/litellm_team_audit_lifecycle fix(team): emit audit events for member_delete and role changes and carry the final roster on team create	2026-09-19 17:37:16 -07:00
ryan-crabbe-berri	38d776bd2b	feat(proxy): re-encrypt stored secrets at boot from LITELLM_MIGRATE_FROM_MASTER_KEY so an unsafe key can be replaced while the proxy refuses to start Rotating through POST /key/regenerate needs a running proxy, which a refused boot does not have. The refusal now counts the stored values that decrypt under the unsafe key. When there are none it only asks for a new key. When there are some it also asks for LITELLM_MIGRATE_FROM_MASTER_KEY, and the next boot with a safe key re-encrypts them and logs that the variable can be deleted. Leaving the variable set afterwards is a no-op with one notice.	2026-09-19 17:32:58 -07:00
yuneng-jiang	1f28813c4d	Merge pull request #42053 from BerriAI/litellm_nova_sonic_v2_e2e_model test(e2e): point the Nova Sonic realtime test at nova-2-sonic	2026-09-19 17:31:07 -07:00
berriai-litellm-provider-info-sync[bot]	260990629a	chore(prices): sync OpenRouter prices: 5 models openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/qwen/qwen3.5-35b-a3b: max_tokens, max_output_tokens, supports_prompt_caching, input_cost_per_token, output_cost_per_token openrouter/qwen/qwen3.5-9b: max_tokens, max_output_tokens openrouter/qwen/qwen3.8-27b: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/z-ai/glm-5.2: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost	2026-09-20 00:30:47 +00:00
yucheng-berri	2ec5c2c7cd	Merge pull request #41740 from BerriAI/litellm_otel_v2_langfuse_llm_spans_only feat(otel v2): opt-in llm_only span scope for Langfuse destinations and the operator Langfuse exporter	2026-09-19 17:24:50 -07:00
Yuneng Jiang	9f84382a24	test(e2e): cite the source and date for the pinned Nova Sonic model id AGENTS.md allows a vendor-owned literal only when its source and date are cited next to it. A live realtime test cannot avoid naming a model, so record how the id was checked, and record that a retired id fails as a hang rather than an error so the next reader does not start by suspecting litellm.	2026-09-19 17:20:00 -07:00
kerry-berri	75f4c11444	Merge pull request #42006 from BerriAI/litellm-providers/price-sync-openrouter chore(prices): sync OpenRouter prices: 2 models	2026-09-19 17:11:50 -07:00
yucheng	de70cf842a	fix(team): run the role update and budget upsert in one transaction under the team lock Some checks failed LiteLLM Rust / rust-lint (push) Has been cancelled Details LiteLLM Rust / rust-test (push) Has been cancelled Details LiteLLM Rust / rust-wheel (push) Has been cancelled Details Terraform Provider / gofmt, vet, build, test (push) Has been cancelled Details Terraform Provider / Provider endpoints vs proxy OpenAPI schema (push) Has been cancelled Details Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-20 00:04:32 +00:00
berriai-litellm-provider-info-sync[bot]	aa8bbdbae4	chore(prices): sync OpenRouter prices: 2 models Some checks failed LiteLLM Rust / rust-lint (push) Has been cancelled Details LiteLLM Rust / rust-test (push) Has been cancelled Details LiteLLM Rust / rust-wheel (push) Has been cancelled Details Terraform Provider / gofmt, vet, build, test (push) Has been cancelled Details Terraform Provider / Provider endpoints vs proxy OpenAPI schema (push) Has been cancelled Details openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost openrouter/z-ai/glm-5.2: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost	2026-09-20 00:00:50 +00:00
yucheng	b7db48c7c1	fix(team): 404 a role update whose target left the roster before the locked read Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-19 23:57:38 +00:00
Yuneng Jiang	ca18755b64	test(e2e): point the Nova Sonic realtime test at nova-2-sonic AWS retired amazon.nova-sonic-v1:0. GetFoundationModel now answers ResourceNotFoundException "This model version has reached the end of its life", and opening a bidirectional stream against it fails with ValidationException "The provided model identifier is invalid". amazon.nova-2-sonic-v1:0 is the active replacement. The test passed on builds 219 (2026-09-16) and 246 (2026-09-17) and has failed every run since, three attempts per build, with no litellm change to the realtime path in between. The symptom was a clean websocket close: Bedrock ends the stream rather than erroring, the forwarder treats a None receive as a normal stream end and closes the client socket, so the client sees ConnectionClosedOK and the test fails waiting for response.done. litellm already carries both models in the cost map, with "deprecation_date": "2026-09-14" on the old one, and the promptStart transformation already sends the audioOutputConfiguration that nova-2-sonic requires; only the test constant was left behind. Verified against live Bedrock with the promptStart shape the transformation builds: amazon.nova-sonic-v1:0 raises "The provided model identifier is invalid", amazon.nova-2-sonic-v1:0 opens a session and returns a usageEvent. The mocked handler and provider-cache tests keep the old id: it is only a label there, no call reaches AWS.	2026-09-19 16:55:00 -07:00
yucheng	f6e5ef0d26	refactor(otel v2): drop the docstring from conflicting_span_scope_error Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-19 23:48:52 +00:00
kerry-berri	1fcef68ab7	Merge pull request #42048 from BerriAI/litellm_fix_circleci_cost_and_bedrock_beta Some checks failed Unit Tests: Proxy DB Operations / auth-checks (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / budgets (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / custom-logging (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / db-and-spend (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / endpoints-and-responses (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / proxy-server-core (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / guardrails-hooks (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / jwt-and-keys (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / key-generation (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / logging-misc (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / proxy-runtime (push) Blocked by required conditions Details Unit Tests: Proxy DB Operations / proxy-utils (push) Blocked by required conditions Details Unit Tests / caching-local (push) Waiting to run Details Unit Tests / core-utils (push) Waiting to run Details Unit Tests / enterprise-package (push) Waiting to run Details Unit Tests / enterprise-routing (push) Waiting to run Details Unit Tests / integrations (push) Waiting to run Details Unit Tests / All Other Providers (push) Waiting to run Details Unit Tests / Vertex AI (push) Waiting to run Details Unit Tests / mcp-integration (push) Waiting to run Details Unit Tests / misc (push) Waiting to run Details Unit Tests / proxy-auth (push) Waiting to run Details Unit Tests / proxy-endpoints (push) Waiting to run Details Unit Tests / proxy-extras (push) Waiting to run Details Unit Tests / proxy-infra (push) Waiting to run Details Unit Tests / proxy-server (push) Waiting to run Details Unit Tests / responses-caching-types (push) Waiting to run Details GitHub Actions Security Analysis / zizmor (push) Waiting to run Details Terraform Provider / gofmt, vet, build, test (push) Has been cancelled Details Terraform Provider / Provider endpoints vs proxy OpenAPI schema (push) Has been cancelled Details fix(test): unbreak the integration-cost and proxy_e2e_anthropic_messages CircleCI jobs on main	2026-09-19 16:45:31 -07:00
yassin	dc4cefe879	fix(router): limit cost poll cooldown exemption to provider 404s Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-19 23:44:03 +00:00
yuneng-jiang	3df159308d	Merge pull request #42042 from BerriAI/litellm_websearch_activation_status feat(ui): report whether the serving proxy has applied web search interception	2026-09-19 16:42:05 -07:00
Joshua Valluru	479360ae87	test(mcp): restore scoped execution and credential isolation regressions	2026-09-19 16:41:31 -07:00
kerry	7966f50c34	fix(test): run the all-beta-headers bedrock cases on Claude Fable 5.1 Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-19 23:33:29 +00:00
kerry	02736e20cc	fix(test): repin fireworks fallback cache-read case to the 50% default Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-19 23:33:29 +00:00
joshua-berri	f49fd22875	Merge pull request #42033 from BerriAI/litellm_mcp_redirect_regressions_7738 test(mcp): cover SDK redirect compatibility	2026-09-19 23:31:33 +00:00
yassin	d669dac012	fix(router): skip cooldown for background response cost poll 404s Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-19 23:25:53 +00:00
mateo-berri	741b10cdc9	chore: merge main into fix/batch-retrieve-model-group	2026-09-19 16:25:39 -07:00
joshua-berri	841193aab2	Merge pull request #42040 from BerriAI/revert-41909-litellm_mcp_oauth_happy_path_e2e Revert "test(e2e): cover MCP OAuth SSO and cold restart persistence"	2026-09-19 23:25:20 +00:00
joshua-berri	93ebc1e281	Merge pull request #42039 from BerriAI/revert-41731-litellm_mcp_integration_regressions_4506 Revert "test(mcp): verify scoped execution and OAuth credential isolation"	2026-09-19 23:24:00 +00:00
yujonglee	271fe58ff0	Merge pull request #42037 from BerriAI/litellm_callbacks_legacy_python refactor(rust): rename legacy callback adapter crate	2026-09-19 16:21:28 -07:00
tin-berri	252a0f1eac	Merge pull request #41617 from BerriAI/litellm_fuse_model_profile_presets feat(router): add maintained Fuse model and harness presets	2026-09-19 16:17:19 -07:00
yucheng	431ddbdd22	test(team): exercise the member-add audit helper directly and drop its dead user_id None guard Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-19 23:17:18 +00:00
tin-berri	cc2c0d0f66	Merge pull request #42001 from BerriAI/litellm_heuristic_v2_scores fix(auto-router): show heuristic v2 score estimates in routing details	2026-09-19 16:16:59 -07:00
yucheng	f63782f678	fix(otel v2): reject a langfuse_span_scope that conflicts with another callback entry on the same team or key Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>	2026-09-19 23:16:54 +00:00
tin-berri	1944d40097	Merge pull request #41177 from BerriAI/litellm_autorouter_baseline_cache fix(proxy): estimate auto-router baseline costs from durable cache history	2026-09-19 16:16:29 -07:00
Yuneng Jiang	dd6a3558d5	Merge remote-tracking branch 'origin/main' into litellm_websearch_activation_status	2026-09-19 16:16:25 -07:00
Yuneng Jiang	c0bc45224c	feat(ui): report whether the serving proxy has applied the interception setting The stored flag is the cluster's desired state and is what the form saves, so it cannot also stand as proof that this process activated the callback: a pod that lagged or failed to apply it would still read as on. Report the process's own registration as a separate read-only field and warn on the page when the two disagree, so a failed activation is visible instead of only logged.	2026-09-19 16:16:17 -07:00
Mateo Wang	af6a1798e2	Revert "test(e2e): cover MCP OAuth SSO and cold restart persistence"	2026-09-19 16:15:43 -07:00
Mateo Wang	57c757e9d7	Revert "test(mcp): verify scoped execution and OAuth credential isolation"	2026-09-19 16:10:47 -07:00
Mateo Wang	0058e1554b	Merge pull request #41909 from BerriAI/litellm_mcp_oauth_happy_path_e2e test(e2e): cover MCP OAuth SSO and cold restart persistence	2026-09-19 16:08:51 -07:00

1 2 3 4 5 ...

51690 commits