Commit graph

22755 commits

Author SHA1 Message Date
Krrish Dholakia
89a7451cb9 fix: fix test 2025-06-20 22:42:30 -07:00
Krrish Dholakia
1322e3b349 style: add more tooltips 2025-06-20 20:52:40 -07:00
Krrish Dholakia
172738b98b feat(team_member_view.tsx): add a tooltip 2025-06-20 20:51:09 -07:00
Krrish Dholakia
895eb28deb fix(teams.tsx): support setting team member budget on create 2025-06-20 18:46:49 -07:00
Krrish Dholakia
003cc54a6d fix(team_member_view.tsx): style improvements 2025-06-20 18:40:49 -07:00
Krrish Dholakia
a627a044f2 fix(team_member_view.tsx): handle scientific notation in string 2025-06-20 18:40:01 -07:00
Krrish Dholakia
c5a3b7bd84 feat(team_membership_view.tsx): show team member spend + max budget on UI 2025-06-20 18:34:25 -07:00
Krrish Dholakia
e986d12ad5 feat(team_member_view.tsx): show team member spend + budget on team info 2025-06-20 18:28:06 -07:00
Krrish Dholakia
8e398607b2 feat(team_info.tsx): show team member budget on team info 2025-06-20 18:18:16 -07:00
Krrish Dholakia
1f56886b59 feat(team_endpoints.py): get team budget table on team info
allows user to see max budget set for team members
2025-06-20 18:15:30 -07:00
Krrish Dholakia
0a4320bbfa feat(team_endpoints.py): return team member budget on team info
allows ui to display this to admin / team member
2025-06-20 18:10:06 -07:00
Krrish Dholakia
6a4e29f87b fix(team_endpoints.py): support updating team budget on UI 2025-06-20 17:57:20 -07:00
Krrish Dholakia
53f0fff340 feat(proxy/_types.py): return team member spend
update pydantic object to include spend

Allows showing spend of team member within team on UI
2025-06-20 17:38:17 -07:00
Krrish Dholakia
ef2a1a43ec feat(team_endpoints.py): support 'team_member_budget' param on /team/update
enables budget working across all team members
2025-06-20 16:31:42 -07:00
Krrish Dholakia
512999f124 test: add unit tests for default team member budget 2025-06-20 16:20:04 -07:00
Krrish Dholakia
90fa3f61a2 feat(team_endpoints.py): support using default team member budget id, if set
allows all team members to use the same budget id
2025-06-20 15:37:51 -07:00
Krrish Dholakia
acef5324b1 feat(team_endpoints.py): support team_member_budget param on /team/new
Allow creating 1 budget for all users within team (makes it easier to increase/reduce budget if needed for all team members)
2025-06-20 15:22:30 -07:00
Krrish Dholakia
2e867ac70f fix(ui_sso.py): ensure user is added to team, if set via default internal settings
allows users signed up via SSO to be added to default team
2025-06-20 13:45:06 -07:00
Ishaan Jaff
2a698062e3
[Feat] UI Allow testing /v1/messages on the Test Key Page (#11930)
* Add ANTHROPIC_MESSAGES to chat UI

* add anthropic-ai/sdk

* add anthropic messages to UI

* add makeAnthropicMessagesRequest

* fixes for endpoint selector
2025-06-20 13:31:24 -07:00
Ishaan Jaff
cfee865f16 fix test MCP 2025-06-20 12:09:45 -07:00
Ishaan Jaff
19f13c842f
add gemini-2.5-pro (#11927) 2025-06-20 11:29:06 -07:00
Krish Dholakia
cf83b541e5
Volcengine - thinking param support + Azure - handle more gpt custom naming patterns (#11914)
* fix(volcengine.py): add thinking param support

Closes https://github.com/BerriAI/litellm/issues/11879

* fix(gpt_transformation.py): handle azure custom names - e.g. `gpt-4-1`

Closes https://github.com/BerriAI/litellm/issues/11834
2025-06-20 09:40:33 -07:00
Cole McIntosh
7abece4ad8
Merge pull request #11899 from colesmcintosh/add-health-check-success-modal
Add success modal for health check responses
2025-06-20 08:33:39 -06:00
Cole McIntosh
0ca70bf92e Merge remote-tracking branch 'origin/main' into add-health-check-success-modal 2025-06-20 08:05:36 -06:00
Krrish Dholakia
957df8d38c bump: version 1.72.8 → 1.72.9 2025-06-19 22:35:01 -07:00
Krish Dholakia
308e82d885
LiteLLM SDK <-> Proxy improvement (don't transform message client-side) + Bedrock - handle qs:.. in base64 file data + Tag Management - support adding public model names (#11908)
* fix(factory.py): handle qs:.. in mime type

Fixes https://github.com/BerriAI/litellm/issues/11839

* feat(litellm_proxy/): don't transform messages client-side

leave litellm proxy messages untouched - allow proxy to handle transformation

 prevents double transformation

* feat(tag_management_endpoints.py): support adding models to tag by adding model_name

Closes https://github.com/BerriAI/litellm/issues/11884

* test(test_tag_management_endpoints.py): add unit tests for adding new model by public model name

* test: update test
2025-06-19 22:34:18 -07:00
Krish Dholakia
0e6f1c089d
fix(proxy_server.py): fix loading ui on custom root path (#11912)
Closes https://github.com/BerriAI/litellm/issues/11865
2025-06-19 22:29:01 -07:00
Krish Dholakia
40cc61c8f3
build(model_prices_and_context_window.json): mark all gemini-2.5 mode… (#11907)
* build(model_prices_and_context_window.json): mark all gemini-2.5 models as supporting pdf input

Closes https://github.com/BerriAI/litellm/issues/11881

* fix(anthropic_transformation.py): set custom llm provider custom property

Fixes https://github.com/BerriAI/litellm/issues/11861

* test: add unit test for checking supports_reasoning

* test: add test for vertex ai flow

* feat(bedrock/anthropic): ensure thinking param correctly passed for bedrock/invoke
2025-06-19 21:07:25 -07:00
Ishaan Jaff
a1abb43319 bump: version 1.72.7 → 1.72.8 2025-06-19 20:44:57 -07:00
Ishaan Jaff
72f73cb56e ui new build 2025-06-19 20:39:28 -07:00
Ishaan Jaff
f6728e6e13
[UI] QA Items for adding pass through endpoints (#11909)
* ui - fix 1

* fixes

* fix path prefix

* fix path
2025-06-19 20:37:53 -07:00
Nathan Brake
1c4fdb4a8f
Enhance Mistral API: Add support for parallel tool calls (#11770)
* Enhance Mistral API: Add support for parallel tool calls and refine name handling in tool messages. Plus, introduce a new test for parallel tool calls in the Mistral model.

* tests

* make mypy happy

* Refine name handling in Mistral chat transformation: clarify conditions for removing the 'name' field based on message role and content.
2025-06-19 20:12:39 -07:00
Victor Krylov
1d58fc5429
Add deployment annotations (#11849)
* Add deployment annotations

* Correct the indent and simplify if 0 annotations
2025-06-19 20:11:31 -07:00
Rinor Maloku
35b791dc49
bumps the anthropic package (#11851) 2025-06-19 20:11:04 -07:00
lgruen-vcgs
e1c77e70c2
Add AWS Bedrock profiles for the APAC region (#11883)
Likely fixes #6905, #9228, and addresses https://github.com/BerriAI/litellm/issues/11057#issuecomment-2903257768.
2025-06-19 20:10:04 -07:00
Ishaan Jaff
d4b34549bc
[Fix] Networking - allow using CA Bundles (#11906)
* fix _get_ssl_context

* fixes for using HTTP handler
2025-06-19 20:09:08 -07:00
Ishaan Jaff
b90d3ca8d0
[Feat] MCP - Allow connecting to MCP with authentication headers + Allow clients to specify MCP headers (#11890) (#11891)
* initial mcp auth with special header (#11890)

Co-authored-by: wagnerjt <wagnerjt@github.com>

* add mcp auth header

* fixes MCP client for litellm proxy

* fixes loc of MCP types

* fixes use MCP client for auth to MCPs

* fix organization

* fix mcp auth header

* add MCP auth header to litellm auth

* fixes for MCP auth

* Add MCP auth to list tools

* fix MCP call tool

* fixes for MCP auth header

* tests for MCP transport

* TestMCPClientUnitTests

* docs MCP auth

* fix types

* docs fix

* fix MCP auth import

* fix code qa check

* test fix mcp auth token check

---------

Co-authored-by: wagnerjt <wagnerjt@github.com>
2025-06-19 20:07:08 -07:00
Pascal Lim
ad2e2302e2
feat: add workload identity federation between GCP and AWS (#10210) 2025-06-19 18:31:58 -07:00
Ishaan Jaff
8cb381b519 ci/cd new build 2025-06-19 17:27:45 -07:00
Ishaan Jaff
0fe8bf2fc2 fix gemini-2.5-flash-lite-preview-06-17 2025-06-19 17:07:34 -07:00
Ishaan Jaff
4796e9c5ba ui - fix linting issue 2025-06-19 16:43:01 -07:00
fatih akyon
5b6ba871a5
[Bug Fix] add missing flash-2.5-flash-lite for gemini provider, fix gemini-2.5-flash pricing (#11901) 2025-06-19 16:38:17 -07:00
Krrish Dholakia
3540984965 test: fix tests 2025-06-19 16:35:31 -07:00
Cole McIntosh
677ef3cdde
Fix health check UI table design - Remove table-in-table design from HealthCheckComponent - Change wrapper from card styling to simple div with mb-6 spacing - Remove padding around table container for cleaner layout - Add proper icon-based actions in health check table - Use PlayIcon for new checks and RefreshIcon for re-running checks - Add loading animation with dots during health checks - Include proper tooltips for action buttons (#11897) 2025-06-19 16:07:43 -07:00
Cole McIntosh
d2e54944a3
Fix clickable model ID in health check table - Add setSelectedModelId prop to make blue model ID buttons clickable - Fix checkbox selection logic to use model names consistently - Add stopPropagation to prevent unwanted sort triggers on checkbox clicks - Now clicking Model ID opens model details, and select all works properly (#11898) 2025-06-19 16:07:23 -07:00
Ishaan Jaff
87c2be93c7
[Feat] V2 Add Pass through endpoints on UI (#11905)
* add pass through ui

* fix accordion for route path

* working route path renderer

* fix use sections

* clean up add pass through form

* docs fix add pass through routing

* clean up route preview

* add route preview
2025-06-19 16:05:29 -07:00
Krrish Dholakia
753ec7298a fix(internal_user_endpoints.py): fix check 2025-06-19 15:53:28 -07:00
Krish Dholakia
c6d7d5bc98
Revert "move buttons to the left (#11771)" (#11904)
This reverts commit bc9f111ee8.
2025-06-19 15:36:47 -07:00
Krrish Dholakia
b05742e814 fix(prometheus.py): fix metrics 2025-06-19 15:30:06 -07:00
Krrish Dholakia
649636b26b build(model_prices_and_context_window.json): ensure tpm/rpm limits are int
Closes https://github.com/BerriAI/litellm/issues/11882
2025-06-19 14:58:16 -07:00