Commit graph

26144 commits

Author SHA1 Message Date
Yuta Saito
dae7d08ff2 Revert "Revert "Merge pull request #14720 from uc4w6c/feat/remove-servername-prefix-mcp_tools""
This reverts commit a88d774f94.
2025-09-29 07:12:24 +09:00
Wenxi Onyx
ad29d2f944 add models served from ollama cloud 2025-09-28 14:06:08 -07:00
Wenxi Onyx
4adb854e51 add models served from ollama cloud 2025-09-28 13:20:35 -07:00
Abhijit L
feac008331 fix: format 2025-09-28 23:52:44 +05:30
Abhijit L
9122614dbe fix: make it discoverable on ui 2025-09-28 23:49:20 +05:30
TobiMayr
3c99d2236a feature/add max requests env var 2025-09-28 19:18:56 +01:00
jacobi petrucciani
6249f4efa5 fix passthrough of atranscription into kwargs going to upstream provider 2025-09-28 12:46:43 -04:00
Cursor Agent
c684a18e38 feat: Add OAuth2 auth and scheduled key rotation
Co-authored-by: teddy <teddy@berri.ai>
2025-09-28 16:39:35 +00:00
Krrish Dholakia
208cd5fcb5 bump: version 1.77.5 → 1.77.6 2025-09-28 09:27:08 -07:00
Krish Dholakia
c328b4a036
Merge pull request #15002 from BerriAI/litellm_dev_09_27_2025_p3
MCP - specify forwardable headers, specify allowed/disallowed tools for MCP servers
2025-09-28 09:21:52 -07:00
Krrish Dholakia
433624706e fix: fix linting errors 2025-09-28 09:18:02 -07:00
Krish Dholakia
cd4b05f61d
Merge pull request #14997 from eycjur/fix_azure_batch
[Fix] Use the `extra_query` parameter for GET requests in Azure Batch
2025-09-28 09:13:07 -07:00
Krish Dholakia
1257033e27
Merge pull request #14998 from herve-ves/fix_ui_blank_litellm_model_name_field
[Fix] Fix LiteLLM model name fallback in dashboard overview
2025-09-28 09:12:08 -07:00
Krrish Dholakia
53d0cbb1b7 fix: update tests + logic for passing multiple headers 2025-09-28 09:09:11 -07:00
Krrish Dholakia
9403efa511 test: fix tests 2025-09-28 08:54:15 -07:00
Krrish Dholakia
1256dd53d9 test: update tests 2025-09-28 08:53:11 -07:00
Krrish Dholakia
e6810b5f87 docs(mcp.md): add allow/disallowed tools to docs 2025-09-28 08:50:40 -07:00
Henry Wang
b46407fa76 feat(gemini): Add full support for native Gemini API translation
This commit implements a complete, end-to-end fix for the native Gemini API translation feature, allowing requests to be correctly routed to other model providers via `model_group_alias`.

The original implementation was broken, causing `systemInstruction` and `tools` to be dropped from requests. This was resolved by refactoring the Gemini endpoint to use a dedicated translation path, similar to the Anthropic adapter.

Additionally, this commit hardens the streaming response adapter to correctly handle tool calls generated by the newly-fixed request path. Key improvements to the response handling include:

- Replaced the fragile `id`-based tool call tracking with a robust `index`-based accumulation logic.
- Fixed a memory leak and improved logging in the stream finalization process.
- Prevented empty, non-compliant chunks from being sent to the client during tool call streaming.
- Optimized the accumulator to skip and log superfluous empty chunks sent by some models.
2025-09-28 21:01:31 +08:00
Abhijit L
0d7256cd4e fix: reject status code and tests. 2025-09-28 16:56:28 +05:30
Abhijit L
8169c61a48 fix: tests 2025-09-28 15:46:38 +05:30
hervelin
0d2cd1b98e UI new build 2025-09-28 18:14:52 +08:00
hervelin
6fc975d7e5 Fix LiteLLM model name fallback in model overview 2025-09-28 18:08:15 +08:00
eycjur
900241e06c fix lint error 2025-09-28 18:21:18 +09:00
eycjur
4f1e409082 use extra_query for get request 2025-09-28 18:03:32 +09:00
Ishaan Jaff
7052108d19 test_completion_azure 2025-09-27 22:44:46 -07:00
Ishaan Jaff
32ed5ae2b9 test_completion_cost 2025-09-27 22:43:51 -07:00
Abhijit L
12333f8c3f fix: pattern for guardrail registration 2025-09-28 11:07:14 +05:30
Sameerlite
d28ffc9e09 remove not needed code 2025-09-28 10:10:55 +05:30
Sameerlite
fc82b81de5 fix mypy 2025-09-28 10:06:59 +05:30
Sameer Kankute
f510ac15f8
Merge branch 'main' into litellm_live_api_passthrough 2025-09-28 09:45:57 +05:30
Krrish Dholakia
340262c85f feat(server.py): only show allowed mcp tools 2025-09-27 20:57:12 -07:00
Krrish Dholakia
526156ed9d feat(mcp/): allows admin to prevent llm's from accidentally deleting github repo's even if user is allowed to do this 2025-09-27 19:36:11 -07:00
abhijitjavelin
aedcedb2b6
Merge branch 'BerriAI:main' into main 2025-09-28 07:53:06 +05:30
Ishaan Jaffer
35c14f7178 Revert "Merge pull request #14821 from hazyone/fix-13380"
This reverts commit 37ea89eff0, reversing
changes made to aede742db5.
2025-09-27 18:52:59 -07:00
Krrish Dholakia
db27600ce9 docs(mcp.md): update docs with new 'extra_headers' tutorial 2025-09-27 18:13:19 -07:00
Krrish Dholakia
327447cb17 fix(mcp/): rename param to be 'extra_headers', instead of 'forwardable_headers' 2025-09-27 17:58:11 -07:00
Krrish Dholakia
c6a7e676f6 fix(server.py): allow user to specify custom headers to forward to mcp server 2025-09-27 17:55:04 -07:00
Ishaan Jaffer
0eedf1028f mypy fix 2025-09-27 17:45:49 -07:00
Ishaan Jaffer
8819f4a9a5 ui new build 2025-09-27 17:38:38 -07:00
Ishaan Jaffer
fea6004b11 bump: version 1.77.4 → 1.77.5 2025-09-27 17:37:31 -07:00
Krrish Dholakia
1c71d4cdbb feat(mcp/): allow specifying forwardable headers
allows admin to specify which clientside headers to forward to the backend mcp server

easier than requiring client to specify `x-mcp-{server_alias}-key`
2025-09-27 17:30:46 -07:00
Ishaan Jaffer
ce57f59531 test_gemini_pass_through_endpoint 2025-09-27 17:17:12 -07:00
Ishaan Jaffer
13b0e97759 ALLOWED_IDS_JSON sec scan 2025-09-27 17:15:28 -07:00
Krrish Dholakia
0ff7177373 feat(user_api_key_auth_mcp.py): pass extra headers from clientside straight through - allow multiple clientside headers
Closes LIT-952
2025-09-27 17:11:06 -07:00
Ishaan Jaffer
9c9b71f62e fix bedrock end of life img gen models 2025-09-27 17:02:48 -07:00
Ishaan Jaffer
0ec7dace79 test_embedding 2025-09-27 16:57:27 -07:00
Ishaan Jaffer
10a801ce83 docs fix 2025-09-27 16:52:02 -07:00
Krrish Dholakia
e73b631524 fix: fix runtime openid check 2025-09-27 16:48:51 -07:00
Krrish Dholakia
e2ce0aa692 fix: make .exception for detailed error log 2025-09-27 16:44:02 -07:00
Ishaan Jaff
6299f07e54
[Draft] v1.77.5 Release note (#14985)
* docs draft

* docs fix

* docs

* docs fix

* doc fix

* docs

* docs fix
2025-09-27 16:33:58 -07:00