scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-05 02:41:56 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 49
53166 commits 3118 branches 1436 tags 4.4 GiB
Commit graph

53166 commits

This branch
This branch
All branches
Author SHA1 Message Date
Devin AI
fc4a11ac53 test(e2e): call the prefixed tool, require two gateways, cite the Linear tool name 
Co-Authored-By: bot_apk <apk@cognition.ai>
 2026-09-19 02:03:12 +00:00
kerry-berri
c4ddea7cfc
Merge pull request #41917 from BerriAI/litellm_fireworks_cache_read_default_discount 
fix(cost_calc): default fireworks cached input to the documented 50% discount when the map has no cache-read rate
 2026-09-18 18:48:58 -07:00
Yujong Lee
0119f50015 fix(rust): restore the 10s connect timeout and share media clients across proxy settings 
Python OCR passes the call timeout per request, so its connect timeout is the call timeout and never the 5s handler default. 10s is what every Rust route uses on main. The media client never uses a proxy, so trust_proxy_env no longer splits its pool key
 2026-09-18 18:47:36 -07:00
Yujong Lee
c635c35b3d fix(rust): keep native OCR on the proxy by declining only a supplied client 
The proxy attaches its shared aiohttp session to every request as shared_session, so declining on it sent every proxy OCR call to Python, which never uses that session for OCR. aclient_session is a litellm global and never a call argument, so that check could not match. The proxy-shaped lifecycle test now asserts the call was served by Rust
 2026-09-18 18:47:36 -07:00
kerry
380ec1a004 docs(integration): keep cost map loading note in README 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:43:00 +00:00
kerry
6ccba7fdb5 test(integration): drive scripted wires and provider wiring from data 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:41:19 +00:00
kerry
4e38f1845d refactor(xai): move native stt routing opt-out behind the provider config 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:40:00 +00:00
mateo-berri
9662b2a35c refactor(responses): type the websocket test parameters and suppress the error-frame send explicitly 2026-09-18 18:35:48 -07:00
Mateo Wang
29bdd1ab47
Merge pull request #41905 from BerriAI/litellm_websearch_failed_search_error_block 
fix(websearch_interception): surface a failed search as a web_search_tool_result_error block and end the turn
 2026-09-18 18:34:11 -07:00
kerry
05cefb1480 fix(cost_calc): coerce string fireworks rates and drop the match fall-through 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:33:41 +00:00
kerry-berri
fc0b37ff5d
Merge pull request #41904 from BerriAI/litellm_bedrock_batch_retrieve_sigv4_over_env_bearer 
fix(bedrock): sign batch retrieve and cancel with deployment credentials when AWS_BEARER_TOKEN_BEDROCK is set
 2026-09-18 18:33:10 -07:00
kerry
77f6166c39 test(integration): fold scenario client into upstream module 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:30:24 +00:00
ryan-crabbe-berri
4b4042c5d1
Merge pull request #41916 from BerriAI/litellm_team_admin_projects_permission 
feat(proxy): let team admins manage projects via team_admin_editable_team_fields
 2026-09-18 18:26:25 -07:00
mateo-berri
06a5594bb6 fix(claude_code_gateway): mint the bearer before consuming the device code so a signing failure never spends the login 2026-09-18 18:25:55 -07:00
kerry
99d91d7205 fix(xai): reject non-success stt responses before parsing 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:22:25 +00:00
mateo-berri
b1b7af884a fix(websearch): forward the deployment api_base to agentic follow-up calls on /v1/messages 2026-09-18 18:19:48 -07:00
kerry
8836410c4c test(cost_calc): drop the unused deepcopy import 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:18:42 +00:00
kerry
c9cd666b36 refactor(cost_calc): move the fireworks cache-read default under litellm/llms 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:18:09 +00:00
ryan-crabbe-berri
5c665827f3
Merge pull request #41910 from BerriAI/litellm_issue_fixed_comment 
ci(issues): comment which release carries the fix when a pull request closes an issue
 2026-09-18 18:17:51 -07:00
yucheng
4e6bf1cfe3 fix(utils): skip null tool_calls when formatting prompts for moderation hooks 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:11:02 +00:00
mateo-berri
fcc7efa4db fix(responses): forward the routed input and report routing rejections on the websocket 2026-09-18 18:10:26 -07:00
mateo-berri
17c519c40a test(custom_httpx): pass the token resolver and two-argument client factory in the realtime bridge test 2026-09-18 18:09:33 -07:00
Yujong Lee
157fa58947 fix(rust): leave calls with a custom URL policy on the Python route 
litellm.user_url_validation and litellm.user_url_allowed_hosts are only implemented by the Python document fetcher, so an allowlisted internal document was rejected by the Rust route's network policy. The bridge now declines when either is changed from its default
 2026-09-18 18:09:14 -07:00
mateo-berri
ca8062e506 fix(claude_code_gateway): keep the device secret out of the browser URL and validate the login before claiming it 2026-09-18 18:07:21 -07:00
mateo-berri
cc2db38871 chore(proxy): keep the OpenAPI snapshot as CI generates it 2026-09-18 18:07:20 -07:00
kerry
1b305cd6b9 fix(cost_calc): default fireworks cached input to the documented 50% discount when the map has no cache-read rate 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:07:07 +00:00
kerry
a1560936f7 fix(timing): use epoch math for detailed pre-processing and drop client-supplied timing windows 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:06:53 +00:00
yassin
453eccb2fa test(router): drop docstrings from the shared tpm regression tests 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:06:50 +00:00
kerry
a124e079c3 refactor(xai): use derived provider set for transcription routing 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:06:09 +00:00
Yassin Kortam
15f63c33bf
Merge pull request #41911 from BerriAI/litellm_rate_limit_reset_time_utc 
fix(rate_limiter): render the 429 reset time in UTC as labelled
 2026-09-18 18:05:45 -07:00
ryan
f3bbeed82f feat(proxy): let team admins manage projects via team_admin_editable_team_fields 
Adds a projects entry to the team_admin_editable_team_fields setting. When set, team admins (legacy admins list or members_with_roles role admin) can call /project/new and /project/update for the teams they administer. The two routes join self_managed_routes so the endpoint check runs instead of the route gate's blanket 401. /project/delete stays proxy admin only

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:02:50 +00:00
mateo-berri
5e0ad06725 docs(websearch): drop the docstring paragraphs the fix reworded 2026-09-18 18:02:25 -07:00
kerry
80b0ea6a2f test(xai): narrow raises match for missing api key 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:00:53 +00:00
ryan
8bd9d356dc test(team): drop docstrings that restate the budget source and reset assertions 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 01:00:31 +00:00
kerry
4565bbee2f style(xai): ruff format stt transformation 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 00:58:44 +00:00
ryan
52a71ff681 fix(team): let team admins reach the member reset_budget route and cover it in the behavior suite 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 00:58:39 +00:00
Yujong Lee
8d2476465f fix(rust): honor environment proxies by default and name the cause in transport errors 
Python's aiohttp transport reads HTTP(S)_PROXY on every request unless disable_aiohttp_trust_env is set, so the Rust clients now do the same instead of requiring aiohttp_trust_env. Transport error messages include reqwest's source chain, so a rejected certificate or refused connection is no longer reported as just 'error sending request'
 2026-09-18 17:58:07 -07:00
kerry
a15b0fa6d2 test(integration): tidy xdist collection bookkeeping 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 00:54:45 +00:00
kerry-berri
f71129f65b
Merge pull request #41847 from BerriAI/litellm_lit_8128_off_peak_pricing_schema 
fix(schema): classify off_peak_pricing as a structured object in the model prices schema generator
 2026-09-18 17:53:13 -07:00
kerry
6f54ad5166 fix(xai): parse integer speaker ids and simplify stt form build 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 00:53:02 +00:00
Devin AI
6247b75543 test(mcp): keep the import block as merged on main 
Co-Authored-By: bot_apk <apk@cognition.ai>
 2026-09-19 00:51:51 +00:00
joshua
77cf6c2fbd ci(mcp): keep dependency-resolution matrix to resolve and import smoke 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 00:50:53 +00:00
kerry
6eb67a8423 test(integration): run the cost shard with xdist workers 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 00:50:29 +00:00
kerry
e52eea84e6 test(integration): serve scripted wires from the shared upstream 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 00:50:26 +00:00
mateo-berri
c65f11bf0f style(websearch): wrap three long lines in the interception handler 2026-09-18 17:50:22 -07:00
Devin AI
e3755a88e7 test(mcp): assert the misconfigured credential message on fail-closed rejections 
Co-Authored-By: bot_apk <apk@cognition.ai>
 2026-09-19 00:50:00 +00:00
ryan
d3a364d74f fix(team): report no budget source when the team default row was deleted 
Derive budget_source from the budget row /team/info actually loaded, so a
metadata id whose row was removed via /budget/delete reads as none instead
of team_default. Share the /team/info test scaffolding so the added patch
calls stay within the TQ008 budget, and allowlist the imperative
reset_budget route in the provider endpoint audit

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 00:49:58 +00:00
kerry
6b0ad3bed3 feat(xai): add speech-to-text via /v1/audio/transcriptions 
Route xai audio transcription through a provider config hitting POST
https://api.x.ai/v1/stt instead of the openai-compatible chat handler
which targets /audio/transcriptions. Supports language, diarize,
keyterm, filler_words and other provider fields as passthrough kwargs

Resolves LIT-8153

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-19 00:49:34 +00:00
jesus
3301fdafaf Merge remote-tracking branch 'origin/main' into litellm_org_alias_from_team 2026-09-19 00:48:54 +00:00
Yassin Kortam
6d8a960e1d
Merge pull request #41667 from BerriAI/litellm_mcp_client_allowlist 
feat(mcp): allowlist MCP client applications at the gateway
 2026-09-18 17:48:36 -07:00