Commit graph

22725 commits

Author SHA1 Message Date
Ishaan Jaff
72f73cb56e ui new build 2025-06-19 20:39:28 -07:00
Ishaan Jaff
f6728e6e13
[UI] QA Items for adding pass through endpoints (#11909)
* ui - fix 1

* fixes

* fix path prefix

* fix path
2025-06-19 20:37:53 -07:00
Nathan Brake
1c4fdb4a8f
Enhance Mistral API: Add support for parallel tool calls (#11770)
* Enhance Mistral API: Add support for parallel tool calls and refine name handling in tool messages. Plus, introduce a new test for parallel tool calls in the Mistral model.

* tests

* make mypy happy

* Refine name handling in Mistral chat transformation: clarify conditions for removing the 'name' field based on message role and content.
2025-06-19 20:12:39 -07:00
Victor Krylov
1d58fc5429
Add deployment annotations (#11849)
* Add deployment annotations

* Correct the indent and simplify if 0 annotations
2025-06-19 20:11:31 -07:00
Rinor Maloku
35b791dc49
bumps the anthropic package (#11851) 2025-06-19 20:11:04 -07:00
lgruen-vcgs
e1c77e70c2
Add AWS Bedrock profiles for the APAC region (#11883)
Likely fixes #6905, #9228, and addresses https://github.com/BerriAI/litellm/issues/11057#issuecomment-2903257768.
2025-06-19 20:10:04 -07:00
Ishaan Jaff
d4b34549bc
[Fix] Networking - allow using CA Bundles (#11906)
* fix _get_ssl_context

* fixes for using HTTP handler
2025-06-19 20:09:08 -07:00
Ishaan Jaff
b90d3ca8d0
[Feat] MCP - Allow connecting to MCP with authentication headers + Allow clients to specify MCP headers (#11890) (#11891)
* initial mcp auth with special header (#11890)

Co-authored-by: wagnerjt <wagnerjt@github.com>

* add mcp auth header

* fixes MCP client for litellm proxy

* fixes loc of MCP types

* fixes use MCP client for auth to MCPs

* fix organization

* fix mcp auth header

* add MCP auth header to litellm auth

* fixes for MCP auth

* Add MCP auth to list tools

* fix MCP call tool

* fixes for MCP auth header

* tests for MCP transport

* TestMCPClientUnitTests

* docs MCP auth

* fix types

* docs fix

* fix MCP auth import

* fix code qa check

* test fix mcp auth token check

---------

Co-authored-by: wagnerjt <wagnerjt@github.com>
2025-06-19 20:07:08 -07:00
Pascal Lim
ad2e2302e2
feat: add workload identity federation between GCP and AWS (#10210) 2025-06-19 18:31:58 -07:00
Ishaan Jaff
8cb381b519 ci/cd new build 2025-06-19 17:27:45 -07:00
Ishaan Jaff
0fe8bf2fc2 fix gemini-2.5-flash-lite-preview-06-17 2025-06-19 17:07:34 -07:00
Ishaan Jaff
4796e9c5ba ui - fix linting issue 2025-06-19 16:43:01 -07:00
fatih akyon
5b6ba871a5
[Bug Fix] add missing flash-2.5-flash-lite for gemini provider, fix gemini-2.5-flash pricing (#11901) 2025-06-19 16:38:17 -07:00
Krrish Dholakia
3540984965 test: fix tests 2025-06-19 16:35:31 -07:00
Cole McIntosh
677ef3cdde
Fix health check UI table design - Remove table-in-table design from HealthCheckComponent - Change wrapper from card styling to simple div with mb-6 spacing - Remove padding around table container for cleaner layout - Add proper icon-based actions in health check table - Use PlayIcon for new checks and RefreshIcon for re-running checks - Add loading animation with dots during health checks - Include proper tooltips for action buttons (#11897) 2025-06-19 16:07:43 -07:00
Cole McIntosh
d2e54944a3
Fix clickable model ID in health check table - Add setSelectedModelId prop to make blue model ID buttons clickable - Fix checkbox selection logic to use model names consistently - Add stopPropagation to prevent unwanted sort triggers on checkbox clicks - Now clicking Model ID opens model details, and select all works properly (#11898) 2025-06-19 16:07:23 -07:00
Ishaan Jaff
87c2be93c7
[Feat] V2 Add Pass through endpoints on UI (#11905)
* add pass through ui

* fix accordion for route path

* working route path renderer

* fix use sections

* clean up add pass through form

* docs fix add pass through routing

* clean up route preview

* add route preview
2025-06-19 16:05:29 -07:00
Krrish Dholakia
753ec7298a fix(internal_user_endpoints.py): fix check 2025-06-19 15:53:28 -07:00
Krish Dholakia
c6d7d5bc98
Revert "move buttons to the left (#11771)" (#11904)
This reverts commit bc9f111ee8.
2025-06-19 15:36:47 -07:00
Krrish Dholakia
b05742e814 fix(prometheus.py): fix metrics 2025-06-19 15:30:06 -07:00
Krrish Dholakia
649636b26b build(model_prices_and_context_window.json): ensure tpm/rpm limits are int
Closes https://github.com/BerriAI/litellm/issues/11882
2025-06-19 14:58:16 -07:00
Ishaan Jaff
cda759c8e7
[Bug Fix]: Fix gemini - web search error with responses API (#11894)
* feat - add websearch tools to responses to chat transform

* test_basic_google_ai_studio_responses_api_with_tools

* fix web search to responses api

* linting fixes
2025-06-19 14:11:35 -07:00
Ishaan Jaff
29bf89cf9c
fix(vertex_ai): Handle missing tokenCount in promptTokensDetails (#11… (#11896)
* fix(vertex_ai): Handle missing tokenCount in promptTokensDetails (#11581)

This PR is a Solution to the Error converting to a valid response block='tokenCount'. File an issue if litellm error - https://github.com/BerriAI/litellm/issues

It's happening because vertex_ai is not sometimes sending the token count for the audio modality.

* test_vertex_ai_usage_metadata_missing_token_count

---------

Co-authored-by: Nishith Jain <167524748+KingNish24@users.noreply.github.com>
2025-06-19 13:54:02 -07:00
Ishaan Jaff
08b2b4f5f5
[Feat] Enable Tool Calling for meta_llama (#11895)
* Enable Tool Calling for `meta_llama` (#11825)

* feat: enable tools and function_call features

* fix: ignore pydantic warnings for StreamingChoices from llama-api

* docs: add tool calling examples

* docs: change default models to Maverick

* docs: fix output of tool use

* test_map_openai_params

---------

Co-authored-by: Young Han <110819238+seyeong-han@users.noreply.github.com>
2025-06-19 13:44:22 -07:00
Ishaan Jaff
e1764af890 fix meta_llama/Llama-3.3-8B-Instruct 2025-06-19 13:44:05 -07:00
Ishaan Jaff
c975355d47
[Feat] UI - Add Allowed MCPs to Creating/Editing Organizations (#11893)
* Add MCP Org controls to UI

* Add allowed MCPs for Orgs
2025-06-19 12:50:09 -07:00
Ishaan Jaff
b30bd155d3 fix pip 2025-06-19 12:29:21 -07:00
Ishaan Jaff
e90473c40e v1.72.6-stable 2025-06-19 12:21:16 -07:00
tanjiro
0a855ad728
rename schema to field_schema (#11887) 2025-06-19 09:29:37 -07:00
Krrish Dholakia
b55e1daff9 docs(self_serve.md): document team param 2025-06-18 23:26:05 -07:00
Krrish Dholakia
753aeffe73 build: update with new migration file 2025-06-18 23:07:13 -07:00
Krrish Dholakia
b080220d02 build: fix gemini-2.5-pro rate limits 2025-06-18 22:56:56 -07:00
Krrish Dholakia
dfafa986ea build(model_prices_and_context_window.json): add gemini google ai studio rate limits 2025-06-18 22:55:54 -07:00
Krrish Dholakia
38eb7c370f docs(sidebars.js): add section for ai tools on integrations tab
make it easier to discover
2025-06-18 22:26:32 -07:00
Krrish Dholakia
6bf66ce919 docs(index.md): add tag 2025-06-18 22:15:30 -07:00
Krrish Dholakia
39a1fbfb35 build: bump versions 2025-06-18 22:14:40 -07:00
Ishaan Jaff
9ec6df59e4 fixes for pass through tests 2025-06-18 21:47:37 -07:00
Ishaan Jaff
8818347acc test scim 2025-06-18 21:42:40 -07:00
Krrish Dholakia
164118df81 docs(litellm_logging_code_coverage.py): fix check 2025-06-18 21:36:03 -07:00
Krish Dholakia
c8bdc552fb
Revert "Revert "UI - allow setting default team for new users (#11874)" (#11876)" (#11877)
This reverts commit 8cfb3cfa94.
2025-06-18 21:30:59 -07:00
Krish Dholakia
8cfb3cfa94
Revert "UI - allow setting default team for new users (#11874)" (#11876)
This reverts commit 65bda75f31.
2025-06-18 21:27:59 -07:00
Krish Dholakia
65bda75f31
UI - allow setting default team for new users (#11874)
* feat(internal_user_endpoints.py): allow passing team-specific details when creating new user with team

allows assigning users to teams on creation

* feat(internal_user_endpoints.py): support for setting team values in default internal user params

Ensures admin can assign all new users to a default team

* test(test_internal_user_endpoints.py): add unit tests

* feat(ui/): allow setting default team on admin UI

easier onboarding for users

* fix(internal_user_endpoints.py): fix exception check
2025-06-18 21:27:32 -07:00
Krish Dholakia
0d09c8ec96
Litellm dev 06 18 2025 p1 (#11872)
* fix(spend_tracking_utils.py): add user agent tags from standard logging payload, in spend logs payload

* feat(litellm_logging.py): identify user agent tags as `User-Agent: ..` and allow admin to disable storing user agent as tag

* fix(azure_ai/): pass content type header in azure ai request

Fixes https://github.com/BerriAI/litellm/issues/11227

* test: add unit test

* fix(router.py): fix passing dynamic credentials to retrieve batch

Fixes batch retrieval when using router

* test: add more unit tests
2025-06-18 21:24:36 -07:00
Ishaan Jaff
c71d50fd09 test_handle_team_membership_changes_add_teams 2025-06-18 21:21:55 -07:00
Ishaan Jaff
3a1a8f5a78
[Bug Fix] - Ensure "Request" is tracked for pass through requests on LiteLLM Proxy (#11873)
* fixes for pt tracing

* test_pass_through_request_contains_proxy_server_request_in_kwargs
2025-06-18 21:15:09 -07:00
karen-veigas
8dbb4f4a3f
Fix: #11853 (#11855)
Updated alerting.md to call the latest model for adding metadata.
2025-06-18 21:05:21 -07:00
Low Jian Sheng
ca6fa63362
Fix gemini 2.5 flash config (#11830)
* fix gemini 2.5 flash config

* add gemini 2.5 flash
2025-06-18 20:16:48 -07:00
Ishaan Jaff
3043df0d30 fixes test scimv2 2025-06-18 16:38:36 -07:00
Ishaan Jaff
6630b39c79
[UI] - Move passthrough endpoints under Models + Endpoints (#11871)
* use cost_per_request

* fix cost_per_request

* fixes cost_per_request

* fixes for cost per request for pass through

* ui fix param name

* fixes for _set_cost_per_request

* test cost per request pass through endpoints

* Update tests/test_litellm/proxy/pass_through_endpoints/test_pass_through_endpoints.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* tests pass through endpoints

* rename left nav

* move pass through to models + endpoints

* move pass through under models

* add pt info view

* add get/update pt

* fixes for PT ui

* allow updating pt endpoints

* fix pass through quick actions

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-06-18 16:26:24 -07:00
Ishaan Jaff
4782d435ed
[Fix] SCIM - Add SCIM PATCH and PUT Ops for Users (#11863)
* fix SCIM memberships Patch

* fixes for SCIM updates

* fixes for SCIM

* working provisioning for teams on SCIM

* working user patch / PUT ops SCIM

* fixes SCIM

* test_scim_v2_endpoints.py

* handle_existing_user_by_email

* fixes for provisioning SCIMUser

* fixes SCIM provisioning

* test scim v2

* fixes for linting

* fix _apply_patch_ops

* fixes code QA check for team membership checks
2025-06-18 16:24:55 -07:00