Ishaan Jaffer
89934f062c
fix ruff check
2025-10-04 08:59:57 -07:00
Ishaan Jaffer
3d981680b0
fix ServerToolUse mypy lint error
2025-10-04 08:59:15 -07:00
Ishaan Jaffer
8e7c593f51
fix: transform_rerank_response
2025-10-04 08:55:48 -07:00
Krrish Dholakia
f5cda40bc6
feat: prisma migration
2025-10-04 08:53:08 -07:00
Ishaan Jaffer
67b0c874a3
ci/cd run again
2025-10-04 08:51:21 -07:00
Krish Dholakia
ad2270fe13
Merge pull request #14764 from daily-kim/litellm_fix_bearer_capitalization
...
Fix: Authorization header to use correct "Bearer" capitalization
2025-10-03 22:02:46 -07:00
Krish Dholakia
7d41f02d02
Merge pull request #14813 from shagunb-acn/bugfix-14404-image-gen-azure-managed-identity
...
#14404 BugFix - Add support for Azure AD token-based authorization in…
2025-10-03 21:53:59 -07:00
Krish Dholakia
c83a3ac9b4
Merge pull request #14939 from Toy-97/patch-1
...
update: DeepInfra model data refresh [2025-09-26]
2025-10-03 21:48:31 -07:00
Krish Dholakia
206f67a11e
Merge pull request #15183 from uc4w6c/fix/test_mcp_server
...
test: fix test_mcp_server.py
2025-10-03 21:44:52 -07:00
YutaSaito
81a8766b84
feat: add JP Cross-Region Inference ( #15188 )
2025-10-03 21:20:04 -07:00
Kowyo
981dd88792
Merge branch 'kowyo/fix-ollama-think' of github.com:kowyo/litellm into kowyo/fix-ollama-think
2025-10-04 02:50:28 +00:00
Kowyo
bb3829b697
fix: update 'think' parameter assignment to use provided value in transformation.py
2025-10-04 02:50:00 +00:00
Kowyo
ef90bb8680
Merge branch 'BerriAI:main' into kowyo/fix-ollama-think
2025-10-04 10:35:20 +08:00
Krrish Dholakia
39cac8e58a
build(ui/): show updated schema.prisma
2025-10-03 19:07:50 -07:00
Krrish Dholakia
aa1b690494
feat(ui/): allow user to edit allowed tools for an mcp server
2025-10-03 19:05:56 -07:00
=
aca8ae7962
fixes issue where empty premium fields were blocking key edit
2025-10-03 18:57:50 -07:00
Krrish Dholakia
6691d0bc85
feat(proxy/): add edit / view for extra headers on MCP servers
2025-10-03 18:57:27 -07:00
Krrish Dholakia
c00cedcf26
feat(ui/): display the MCP extra headers on the UI
...
allow user to see what extra headers they set
2025-10-03 18:43:41 -07:00
Krrish Dholakia
562e7a4e03
feat(proxy/_types.py): add new extra_headers param support to API request
...
allows admin to specify which headers they want to forward to the backend MCP server
2025-10-03 18:29:37 -07:00
Krrish Dholakia
274c5e963d
feat(ui/): allow user to forward additional headers to the MCP server from the UI
2025-10-03 18:22:11 -07:00
Krrish Dholakia
950210790b
feat(create_mcp_server.tsx): initial ui component for adding extra headers, allowed tools, disallowed tools to litellm ui
...
Closes LIT-1183
2025-10-03 18:12:31 -07:00
Krrish Dholakia
72b5cf2b71
fix(schema.prisma): add new db columns
2025-10-03 17:57:25 -07:00
Krrish Dholakia
45f7f86480
feat(mcp_servers.tsx): show health of mcp servers on UI
...
allow user to know if mcp server is in invalid state
2025-10-03 17:42:06 -07:00
Krrish Dholakia
3816d3b36f
test: add unit testing
2025-10-03 17:27:49 -07:00
Krrish Dholakia
6ccb20d69d
fix(mcp_server_manager.py): mark mcp server as unhealthy and show reason for not being able to serve it on list servers on ui
...
make it easy for user to debug why server can't be added
2025-10-03 17:25:08 -07:00
Krrish Dholakia
c043ad6c2b
fix: replace list in for set in
...
faster
2025-10-03 17:17:20 -07:00
Krrish Dholakia
69edc546c0
fix(mcp_server_manager.py): don't return an invalid server id on list servers
...
Prevents user from hitting 'server not found' error, even when they see it being listed on litellm ui
2025-10-03 17:15:15 -07:00
Krrish Dholakia
742038bb5e
build: deploy/
...
push new prisma migration
2025-10-03 16:52:03 -07:00
Yuta Saito
359aaa947f
test: fix test_mcp_server.py
2025-10-04 08:18:15 +09:00
Ishaan Jaff
10d6d72ae3
[Feat] VertexAI - Support googlemap grounding in vertex ai ( #15179 )
...
* add VertexToolName
* test_vertex_tool_params
* fix: working maps grounding
* test_gemini_google_maps_tool_simple
* test_vertex_ai_map_google_maps_tool_with_location
* fix # noqa: PLR0915
* _extract_google_maps_retrieval_config
* fixes for linting
* docs: **Google Maps**
2025-10-03 16:07:51 -07:00
Ishaan Jaff
4415b195d1
Add "eu.anthropic.claude-sonnet-4-5-20250929-v1:0" in "model_prices_and_context_window.json" ( #15181 )
...
* feat: add eu.anthropic.claude-sonnet-4-5-20250929-v1:0
* fix: nvidia_nim_models
2025-10-03 15:52:18 -07:00
Krish Dholakia
3095f43e92
Merge pull request #15007 from TobiMayr/feature/add-max-requests-env-var
...
feature/add max requests env var
2025-10-03 15:30:15 -07:00
Krish Dholakia
c5de073732
Merge pull request #15072 from speglich/fix/oci-support
...
Fix OCI Generative AI Integration when using Proxy
2025-10-03 15:29:21 -07:00
Krish Dholakia
343eeaf53f
Merge pull request #15102 from BerriAI/litellm_message_api_cost_tracking
...
(Feat) Add cost tracking for /v1/messages
2025-10-03 15:27:49 -07:00
Krish Dholakia
b41041fc49
Merge pull request #15146 from JVenberg/fix/session-cookie-infinite-logout-loop
...
[Fix] Session Token Cookie Infinite Logout Loop
2025-10-03 15:23:49 -07:00
Krish Dholakia
f05dc27551
Merge pull request #15160 from danielaskdd/fix-whitespace-handling
...
Fix(critical) : Preserve Whitespace Characters in Model Response Streams
2025-10-03 15:23:07 -07:00
rishiganesh2002
d36c8d6bbe
[Feat] MCP Gateway Fine-grained Tools Addition ( #15153 )
...
* feat: UI to add specific tools under creating MCP connection
* chore: pydantic + prisma changes
* feat: adding specific MCP tools now works
* fix: allowed tools filtering
* chore: filtered list to mcp server cost config
* chore: update Readme
* chore: refactor the filtering
* test: Added tests
When the allowed_tests is null, empty list or populated
* chore: resolve the proxy issue
* feat: updating MCP tool filtering
2025-10-03 10:16:29 -07:00
yangdx
8b95cd3ed2
Fix whitespace handling in _has_meaningful_content function
...
• Preserve newlines and spaces as content
• Remove .strip() call on strings
• Treat all non-empty strings as meaningful
• Update logic comment for clarity
• Fix edge case with whitespace-only text
2025-10-03 13:46:51 +08:00
shagunb-acn
13d38e2bed
Merge branch 'BerriAI:main' into bugfix-14404-image-gen-azure-managed-identity
2025-10-03 10:07:31 +05:30
Sameer Kankute
507b0973b4
fix lint code
2025-10-03 08:21:07 +05:30
Ishaan Jaffer
94a89cd7de
ruff fix
2025-10-02 19:22:31 -07:00
Krish Dholakia
1d548d7235
Merge pull request #15155 from BerriAI/litellm_dev_10_02_2025_p1
...
Litellm dev 10 02 2025 p1
2025-10-02 19:04:59 -07:00
Ishaan Jaff
efa782d6d2
[Feat] Add Nvidia NIM Rerank Support ( #15152 )
...
* feat: add NvidiaNimRerankConfig
* fix: NvidiaNimRerankConfig
* fix: NvidiaNimRerankConfig
* fix routing to nvidia nim
* docs nvidia nim rerank
* TestNvidiaNim
* nvidia nim rerank fixes
* fix rerank
* transform_rerank_response
* Usage with LiteLLM Proxy
* fixes linting
* NvidiaNimRerankConfig.DEFAULT_NIM_RERANK_API_BASE
* fix Custom API Base URL
* fix rerank base
* fix main.py
* fix transform
* fix linting
* map_cohere_rerank_params
* ruff fix
* linting fixes
* ruff fix
2025-10-02 18:58:52 -07:00
Alexsander Hamir
79c24be48b
[Fix] - Router: optimize unhealthy deployment filtering in retry path (O(n*m) → O(n+m)) ( #15110 )
...
* perf(router): optimize unhealthy deployment filtering in retry path
Convert unhealthy_deployments list to set for O(1) lookups in
_async_get_healthy_deployments, reducing complexity from O(n*m) to O(n+m).
This method is called on every retry attempt (inside the retry loop), so
the optimization compounds during failures:
Before: 100 deployments × 50 unhealthy = 5,000 operations per call
After: 100 deployments + 50 unhealthy = 150 operations per call
Impact during cascading failures:
- With 1000 req/sec, 40% error rate, 3 retries
- Prevents 32M+ operations/sec during incidents
- Critical for preventing router CPU spikes when you need performance most
Matches the pattern already used in _filter_cooldown_deployments (line 7272).
* fix: Undefined name HTTPException
2025-10-02 18:55:18 -07:00
Sameer Kankute
544db8d140
(feat)Litellm x twelvelabs bedrock[Async Invoke Support] ( #14871 )
...
* Add async invoke support
* Add docs and correct embedding response
* fix cicd erros
* fix cicd erros
* fix mypy error
* Add litellm param input_type
* Update the docs
2025-10-02 18:52:33 -07:00
Ishaan Jaffer
9c29f35c4b
test_end_user_jwt_auth
2025-10-02 18:48:11 -07:00
Krish Dholakia
bfd5f8a6f1
Merge pull request #15156 from DrQuacks/top-api-key-tags
...
Top api key tags
2025-10-02 18:47:17 -07:00
DrQuacks
9a27eb5d0c
edited tests to allow build
2025-10-02 18:32:26 -07:00
Krrish Dholakia
338bfcd21b
fix(proxy_server.py): handle decrypting model list from db, when litellm params is base model
2025-10-02 18:07:20 -07:00
João Speglich
afc9d258e3
oci: fix drop params parameter
2025-10-02 22:01:04 -03:00
