scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-30 01:52:18 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 70
53300 commits 2968 branches 1429 tags 3.9 GiB
Commit graph

53300 commits

This branch
This branch
All branches
Author SHA1 Message Date
yassin
1e7c5400fd fix(proxy): canonicalize azure speech paths and bill uploaded short audio 
Resolve dot segments in the /azure_speech endpoint path before the endpoint family and the admin-only batch guard are decided, so the guard and the forwarded upstream path agree. Bill short-audio requests for the longer of the uploaded audio duration and the recognized duration, so a NoMatch or silence response still charges for the audio Azure processed

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 19:27:25 +00:00
Yuneng Jiang
51f0620439
test(e2e): use deployed Azure model 2026-09-18 12:24:25 -07:00
mateo-berri
b4dc081c27 fix(mistral): never round reasoning_effort none onto the strength ladder 2026-09-18 12:22:34 -07:00
Devin AI
a774e71175 test(bedrock_mantle): document mantle in-region pricing invariant 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 19:18:45 +00:00
Devin AI
31f1c5d331 fix(openrouter): refresh glm-5.3, glm-latest, deepseek-flash-latest and hy3 pricing 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 19:18:14 +00:00
Devin AI
2299846b48 fix(bedrock_mantle): align gpt-5.6-sol pricing with the AWS in-region model card 
Co-authored-by: kusumakarb <kusumakarbvss@gmail.com>
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 19:18:02 +00:00
yassin
b5ad17e848 test(docs): read only the first column of the router_settings reference table 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 19:16:26 +00:00
yassin
aad89de4b4 build(deps): bump anyio to 4.14.2 in uv.lock to clear GHSA-5p39-cfhj-2xmp and GHSA-82r6-8w77-94w6 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 19:13:56 +00:00
yassin
649d299c44 Merge remote-tracking branch 'origin/main' into litellm_fix_tpm_window_reset_sibling_counters 2026-09-18 19:13:05 +00:00
yassin
afa8b8a903 test(docs): read only the first column of the router_settings reference table 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 19:11:39 +00:00
yassin
84f7adec2e fix(passthrough): match deepgram listen routes served under a path prefix 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 19:06:24 +00:00
Devin AI
53fcdfc483 Merge remote-tracking branch 'origin/main' into litellm_qwen3_8_omni_flash 2026-09-18 19:02:21 +00:00
Mateo Wang
a2626726a2
Merge pull request #40500 from BerriAI/litellm_bedrock_aws_auth_params 
fix(bedrock): send aws_session_tags on every STS call via one typed auth struct
 2026-09-18 12:01:52 -07:00
yassin
c5919a3c0e Merge remote-tracking branch 'origin/main' into litellm_mcp_client_allowlist 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

# Conflicts:
#	litellm/proxy/_experimental/mcp_server/server.py
#	litellm/proxy/proxy_server.py
 2026-09-18 19:01:08 +00:00
ryan-crabbe-berri
ed9e666b54
Merge pull request #41351 from BerriAI/litellm_routing_groups_atomic_validation 
fix(router): validate routing_groups at save time and keep invalid DB groups from blocking SSO load
 2026-09-18 11:59:21 -07:00
mateo-berri
c1e39810ec fix(mistral): send reasoning_effort as a level the model accepts 
Declare the live-verified reasoning_effort_levels on the Mistral cost-map
entries and round an undeclared request to the nearest declared level
(up to the weakest level at least as strong, down to the strongest when
the request exceeds the ceiling). Codex's default medium no longer 400s
on mistral-medium-latest, mistral-small-latest, or the vibe-cli family;
an entry that declares nothing keeps forwarding the value verbatim
 2026-09-18 11:58:04 -07:00
kerry
fb8816d826 Merge remote-tracking branch 'origin/main' into litellm_lit_8128_off_peak_pricing_schema 2026-09-18 18:55:24 +00:00
mateo-berri
73fddb999e fix(router): resolve stream_timeout before generic timeouts on the passthrough route 2026-09-18 11:53:26 -07:00
yassin
307df09792 test(mcp): assert the self-revoke response instead of echoing the delete mock 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 18:51:43 +00:00
ryan-crabbe-berri
839c040b53
Merge pull request #41695 from BerriAI/litellm_issue_classifier 
ci: classify new issues into domain, provider, kind, priority and lift labels
 2026-09-18 11:50:56 -07:00
Mateo Wang
adb5ee0881
Merge pull request #41275 from BerriAI/litellm_azure_strip_file_format 
fix(azure): strip litellm format field from file and image content parts
 2026-09-18 11:46:23 -07:00
yassin
3a5f286273 Merge remote-tracking branch 'origin/main' into litellm_fix_tpm_window_reset_sibling_counters 2026-09-18 18:44:33 +00:00
Mateo Wang
88c9dd1294
Merge pull request #41511 from BerriAI/litellm_foundry_a2a_entra_agents 
feat(a2a): reach Microsoft Foundry agents with Entra auth and versioned card discovery
 2026-09-18 11:44:14 -07:00
mateo-berri
cf08440557 fix(azure-ai): price FLUX.2 Flex by its resolved cost map key 2026-09-18 11:42:52 -07:00
mateo-berri
a4da989aa9 test(bedrock): type the STS recording helper 2026-09-18 11:42:52 -07:00
yassin
1e6b33ffab Merge remote-tracking branch 'origin/main' into litellm_azure_speech_passthrough 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

# Conflicts:
#	helm/litellm/templates/ingress.yaml
#	litellm/proxy/_types.py
#	litellm/proxy/pass_through_endpoints/llm_passthrough_endpoints.py
#	litellm/proxy/pass_through_endpoints/success_handler.py
#	terraform/litellm/aws/locals.tf
#	terraform/litellm/gcp/locals.tf
#	tests/test_litellm/proxy/middleware/test_billable_request_metrics_middleware.py
 2026-09-18 18:42:22 +00:00
Yassin Kortam
1653d132c5
Merge pull request #41506 from BerriAI/litellm_vertex_gcs_file_content_streaming 
feat(vertex_ai): stream GCS batch output files from /v1/files/{id}/content
 2026-09-18 11:42:14 -07:00
mateo-berri
42541a9233 fix(proxy): drop echoed cost-map pricing on a row's next save and build /model/info pricing stamps without mutation 2026-09-18 11:42:07 -07:00
yassin
aeca6ed7ba chore: merge main into litellm_deepgram_listen_websocket_passthrough 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 18:39:39 +00:00
yassin
048aaad627 Merge remote-tracking branch 'origin/main' into litellm_mcp_admin_terminate_sessions_revoke_credentials 2026-09-18 18:39:16 +00:00
Yassin Kortam
0594dd7caf
Merge pull request #41539 from BerriAI/litellm_vault_login_secret_namespace 
feat(vault): add separate login and secret namespaces for HashiCorp Vault
 2026-09-18 11:38:49 -07:00
Yassin Kortam
84ae0805ba
Merge pull request #41620 from BerriAI/litellm_team_member_temp_budget_increase 
feat(proxy): temporary budget increase for team members
 2026-09-18 11:38:34 -07:00
ryan-crabbe-berri
539ac2bc01 ci(issue-classifier): name every workflow, script and job after the issue it works on 
Everything this stack adds now carries issue in its file name, workflow name
and job id, so one search finds all of it:

  ls .github/workflows/issue_*
  grep -ril issue scripts .github/prompts .github/*.json

Renames: label_sync.yml -> issue_label_sync.yml, label_claude_code.yml ->
issue_label_claude_code.yml, .github/labels.json -> .github/issue-labels.json,
scripts/sync-labels(.test).ts -> scripts/sync-issue-labels(.test).ts. Job ids
now match the script they run: classify-issue-tests, classify-issue,
label-issue, sync-issue-labels-tests, sync-issue-labels, label-claude-code
 2026-09-18 11:37:55 -07:00
ryan-crabbe-berri
333ed01878 ci(issue-classifier): give the classifier and label jobs unique check-run names 
code-quality's job name collision check flagged classify (also in
duplicate_issue_check.yml) and label (also in label_claude_code.yml)
 2026-09-18 11:37:55 -07:00
ryan-crabbe-berri
e37bd7c60b fix(issue-classifier): queue runs per issue and judge edits by live labels 
An edit during the first run used to cancel it, and the edited run then
skipped because the webhook payload had no needs:template yet, so a
well-formed issue edited within the first minute was never labelled.
Runs for one issue now queue, and the script decides an edited event
against the live labels: a domain label means leave it alone, a gated
issue is re-run, and an unlabelled issue is re-run for its first hour
 2026-09-18 11:37:55 -07:00
ryan-crabbe-berri
9c0a840122 ci(issue-classifier): parse only form headings and keep the claude code label 
Split the issue body only on headings the two forms actually emit, keep the
first value when a heading repeats, cap each field on its own so a long config
cannot push the repro out of the model's view, and only treat comments from
github-actions[bot] as the template notice. The claude code keyword label the
deleted component labeler used to add gets its own small workflow.
 2026-09-18 11:37:55 -07:00
ryan-crabbe-berri
294a9e15de ci: classify new issues into domain, provider, kind, priority and lift labels 
Every issue opened from now on is gated on the template headings, sent once
through the LiteLLM proxy with a strict JSON schema, and labelled from the
manifest in .github/labels.json. Old-template issues are not touched. The bug
template shrinks to Description, Config, LiteLLM Version and Steps to Repro,
both templates gain a domain dropdown, and the labelers that keyed off the old
component dropdown go away.
 2026-09-18 11:37:55 -07:00
ryan-crabbe-berri
30035f817b
Merge pull request #40935 from BerriAI/litellm_codex_duplicate_issue_check 
ci: replace the title-similarity duplicate bot with a Codex semantic check
 2026-09-18 11:37:51 -07:00
Yassin Kortam
f6d9b2552f
Merge pull request #41692 from BerriAI/litellm_mcp_gateway_sessions_by_client_user 
feat(mcp): show live gateway sessions by AI client and user
 2026-09-18 11:37:16 -07:00
Yassin Kortam
ca79c393d5
Merge pull request #41636 from BerriAI/litellm_per_key_end_user_default_budget 
feat(proxy): per-key default budget for dynamically created customers
 2026-09-18 11:36:59 -07:00
Yassin Kortam
f129e7e2d0
Merge pull request #41515 from BerriAI/litellm_transcribe_passthrough 
feat(proxy): add Amazon Transcribe pass-through with completion-time job pricing
 2026-09-18 11:35:06 -07:00
yassin
3219a875d0 fix(proxy): serialize in-memory window rollover and reset siblings once per expired window 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 18:20:18 +00:00
yassin
3b8f887686 ci: rerun proxy-infra after main timeout 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 18:19:32 +00:00
Yassin Kortam
d42f448e41
Merge pull request #41585 from BerriAI/litellm_lazy_fastapi_bpe_imports 
perf: defer fastapi and tiktoken BPE imports out of import litellm
 2026-09-18 11:19:13 -07:00
Yassin Kortam
660f3dfdd3
Merge pull request #41555 from BerriAI/litellm_max_parallel_requests_queue_size 
feat(router): reject with 429 when a deployment's max_parallel_requests slots are all in use
 2026-09-18 11:18:08 -07:00
kerry
4b215e2a60 fix(schema): require a schedule and well-formed windows in off_peak_pricing 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 18:17:36 +00:00
mateo-berri
860b0203c0 test(bedrock): expect canonical session tags in the dynamic auth params propagation test 2026-09-18 11:17:34 -07:00
kerry
cbcb55af89 fix(schema): classify off_peak_pricing as a structured object in the model prices schema generator 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-18 18:11:17 +00:00
dependabot[bot]
639c71e5bb
chore(deps): bump anyio from 4.13.0 to 4.14.2 
Bumps [anyio](https://github.com/agronholm/anyio) from 4.13.0 to 4.14.2.
- [Release notes](https://github.com/agronholm/anyio/releases)
- [Commits](https://github.com/agronholm/anyio/compare/4.13.0...4.14.2)

---
updated-dependencies:
- dependency-name: anyio
  dependency-version: 4.14.2
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2026-09-18 18:09:20 +00:00
kerry
d68e20e586 Merge remote-tracking branch 'origin/litellm_e2e_cost_calculation_scripted_provider' into litellm_e2e_cost_calculation_scripted_provider
Some checks failed
LiteLLM Rust / rust-lint (push) Has been cancelled
Details
LiteLLM Rust / rust-test (push) Has been cancelled
Details
LiteLLM Rust / rust-wheel (push) Has been cancelled
Details
2026-09-18 18:05:20 +00:00