Commit graph

22784 commits

Author SHA1 Message Date
Cole McIntosh
3ab1dfad08
Add GitHub Actions workflow for LLM translation testing artifacts (#11780)
* Add GitHub Actions workflow for LLM translation testing artifacts

* Update LLM translation testing workflow to fetch results from CircleCI and improve timeout settings. The job name has been changed for clarity, and the installation of dependencies has been replaced with CircleCI CLI setup. Placeholder test results are created if no CircleCI artifacts are found.
2025-06-23 09:23:27 -07:00
Cole McIntosh
464d981f1c
feat: add Last Success column to health check table (#11903) 2025-06-23 09:22:00 -07:00
hsuyuming
e3ba888c63
fix: make response api support Azure Authentication method (#11941)
* fix: make response api support Azure Authentication method
1. Support diverse Azure authentication methods
2. Use distinct headers for API key and Azure AD token base on this
   documentation (https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/responses?tabs=rest-api#generate-a-text-response)

* fix: fix path issue

* fix lint error

* rename test_transformation.py to test_azure_transformation.py

* change litellm_params as Optional type
2025-06-23 08:43:20 -07:00
Ishaan Jaff
05b95eb702
docs - Recommended Machine Specifications (#11980) 2025-06-23 08:26:29 -07:00
Graham Neubig
2d05692e2f
Fix SambaNova 'created' field validation error - handle float timestamps (#11971)
* Fix SambaNova 'created' field validation error

SambaNova API returns 'created' field as float but LiteLLM expects integer.
Added _safe_convert_created_field() helper to handle float->int conversion
while maintaining backward compatibility with existing integer timestamps.

* Update litellm/litellm_core_utils/llm_response_utils/convert_dict_to_response.py

---------

Co-authored-by: openhands <openhands@all-hands.dev>
2025-06-23 07:53:21 -07:00
Ishaan Jaff
b36dbb870c fix ghcr 2025-06-22 09:06:58 -07:00
Ishaan Jaff
9e5c97aabd fix pip pkg 2025-06-22 09:05:45 -07:00
Krrish Dholakia
c0de1320fc docs(index.md): update release notes with default team for new users 2025-06-21 23:09:47 -07:00
Ishaan Jaff
b1e3507d14 ui new build 2025-06-21 20:53:18 -07:00
Krish Dholakia
7f3d8bb9c5
Management Fixes - don't apply default internal user settings to admins + preserve all model access for teams with empty model list, when team model added + /v2/model/info fixes (#11957)
* fix(internal_user_endpoints.py): don't apply default internal user params if role is admin

prevent internal user restrictions from being applied to admin

* fix(proxy_server.py): fix model info v2 endpoint check - handle user_id being none

* fix(team_endpoints.py): ensure team doesn't lose all model access if set as empty string and new team model added

* fix(proxy_server.py): ensure model with team id is only added as valid for team which has that id
2025-06-21 20:33:10 -07:00
Krrish Dholakia
10cf7d52eb docs: add further reading link in self serve docs 2025-06-21 17:03:25 -07:00
Krish Dholakia
3224b0f4fe
(Tutorial) Onboard Users for AI Exploration (#11955)
* fix: allow setting no-default-models and unsetting max budget

* docs(sso_self_serve.md): add e2e tutorial of onboarding users for ai exploration

* docs: rename doc
2025-06-21 16:54:23 -07:00
Ishaan Jaff
1b43ba9426 bump: version 1.72.9 → 1.73.0 2025-06-21 16:45:34 -07:00
Ishaan Jaff
84bacef587 test_internal_user_endpoints.py 2025-06-21 16:45:14 -07:00
Ishaan Jaff
9867432ef4 docs pass through 2025-06-21 16:41:04 -07:00
Ishaan Jaff
6cd799a78c docs release notes 2025-06-21 16:37:35 -07:00
Ishaan Jaff
94a8ae393c bump litellm-enterprise-0.1.8 2025-06-21 16:00:36 -07:00
Ishaan Jaff
7006cd4139 test ui sso 2025-06-21 15:58:48 -07:00
Ishaan Jaff
6cd2fe4879 test_team_endpoints.py 2025-06-21 15:57:58 -07:00
Ishaan Jaff
a3bfd29104 fixes release notes 2025-06-21 15:38:54 -07:00
Ishaan Jaff
30d6301a94 fix release notes 2025-06-21 15:37:12 -07:00
Ishaan Jaff
9aef2cdea6 docs pass through 2025-06-21 15:36:34 -07:00
Krish Dholakia
2404d3fb1b
Show user all models they can call (Across teams) on UI (#11948)
* fix(proxy_cli.py): check for module not found error on proxy import

Fixes https://github.com/BerriAI/litellm/issues/11836

* feat(proxy_server.py): utility function to get all models across all teams user is in

Allows user to see all team models on UI

* feat(proxy_server.py): return models accessible via team id's in `/v2/model/info`

Allows UI to tell user which team they can use to access model

* feat(columsn.tsx): initial PR to add 'accessible via Team ID's on model hub

allows user to know what teams they can access a model through

* Revert "feat(columsn.tsx): initial PR to add 'accessible via Team ID's on model hub"

This reverts commit f844c79383.

* fix(proxy_server.py): backend model info endpoint improvements

* UI Improvements for Default User access (#11952)

* feat(ui/): add a 'current team' and 'view' filters to the models page

allow user to see what all models they have access to within a specific team

* feat: working ui for seeing models in teams

* fix(model_dashboard.tsx): make current team filter more prominent

* style(model_dashboard.tsx): add a helpful note telling user how to create a model for the team they've selected

* style(model_dashboard.tsx): only show helpful note when current view is team, not for global

* fix(team_dropdown.tsx): allow searching by team id on create key modal

* feat(create_key_button.tsx): add helpful message when team selection is required

* fix: fix linting checks

* fix: fix ui linting error

* docs(team_endpoints.py): document new param
2025-06-21 15:29:25 -07:00
Krrish Dholakia
6c17e856d1 fix: fix linting error 2025-06-21 15:29:10 -07:00
Ishaan Jaff
db219ffca0 docs pass through 2025-06-21 15:24:17 -07:00
Ishaan Jaff
c7972b55ce docs - pass through 2025-06-21 15:18:15 -07:00
Ishaan Jaff
0bed17068b docs add imgs 2025-06-21 15:11:58 -07:00
Ishaan Jaff
045026462f ui - add team indicator to ui 2025-06-21 14:55:09 -07:00
Krrish Dholakia
b7843b9113 docs(team_endpoints.py): document new param 2025-06-21 14:39:45 -07:00
Ishaan Jaff
1c30d2745f fix is_team_count_over_limit 2025-06-21 14:28:05 -07:00
Ishaan Jaff
1bfe6a1110 test_get_user_groups_pagination 2025-06-21 14:24:04 -07:00
Ishaan Jaff
18c93d99cd test ui sso 2025-06-21 14:17:57 -07:00
Krrish Dholakia
15eadbeb4d fix(internal_user_endpoints.py): add remaining team usage on license usage api 2025-06-21 13:46:30 -07:00
Ishaan Jaff
af3c49def3
[Docs] [Pre-Release] v1.73.0-stable (#11950)
* draft 1.73.0

* fixes

* docs pass through

* clean up

* docs fix

* docs fixes

* docs fix

* docs - Logging / Guardrails Integrations

* v1.73.0

* docs fixes

* fixes v2 heath check

* docs fix

* docs vertex img gen

* docs fix

* docs link

* docs azure responses

* azure codex

* docs fixes

* fixes release notes

* fix docs

* docs pre release
2025-06-21 11:38:37 -07:00
Ishaan Jaff
57121b4fcc
[Chore] Check team counts on license when creating new team (#11943)
* is_team_count_over_limit

* add is_team_count_over_limit
2025-06-21 08:54:17 -07:00
Jianqi Pan
c4c8d9a250
fix(acompletion): allow dict for tool_choice argument (#11860) 2025-06-20 23:21:53 -07:00
Johnny.H
e8ce3995ca
fix aws bedrock claude tool call index (#11842) 2025-06-20 23:21:08 -07:00
Thakee Nathees
34bfaf5e71
Support for Ollama Structured output json_schema (#11880) 2025-06-20 23:19:53 -07:00
Erv Walter
aaa41d1e24
Update Azure o3 pricing to match OpenAI pricing ($2/$8 per 1M tokens) (#11937)
* Initial plan for issue

* Update Azure o3 pricing to match OpenAI pricing ($2/$8 per 1M tokens)

Co-authored-by: ervwalter <768790+ervwalter@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ervwalter <768790+ervwalter@users.noreply.github.com>
2025-06-20 23:17:46 -07:00
Krrish Dholakia
1e6d43e761 Squashed commit of the following:
commit 440bc02725
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 23:04:11 2025 -0700

    fix: fix check

commit 89a7451cb9
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 22:42:30 2025 -0700

    fix: fix test

commit 1322e3b349
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 20:52:40 2025 -0700

    style: add more tooltips

commit 172738b98b
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 20:51:09 2025 -0700

    feat(team_member_view.tsx): add a tooltip

commit 895eb28deb
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 18:46:49 2025 -0700

    fix(teams.tsx): support setting team member budget on create

commit 003cc54a6d
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 18:40:49 2025 -0700

    fix(team_member_view.tsx): style improvements

commit a627a044f2
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 18:40:01 2025 -0700

    fix(team_member_view.tsx): handle scientific notation in string

commit c5a3b7bd84
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 18:34:25 2025 -0700

    feat(team_membership_view.tsx): show team member spend + max budget on UI

commit e986d12ad5
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 18:28:06 2025 -0700

    feat(team_member_view.tsx): show team member spend + budget on team info

commit 8e398607b2
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 18:18:16 2025 -0700

    feat(team_info.tsx): show team member budget on team info

commit 1f56886b59
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 18:15:30 2025 -0700

    feat(team_endpoints.py): get team budget table on team info

    allows user to see max budget set for team members

commit 0a4320bbfa
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 18:10:06 2025 -0700

    feat(team_endpoints.py): return team member budget on team info

    allows ui to display this to admin / team member

commit 6a4e29f87b
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 17:57:20 2025 -0700

    fix(team_endpoints.py): support updating team budget on UI

commit 53f0fff340
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 17:38:17 2025 -0700

    feat(proxy/_types.py): return team member spend

    update pydantic object to include spend

    Allows showing spend of team member within team on UI

commit ef2a1a43ec
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 16:31:42 2025 -0700

    feat(team_endpoints.py): support 'team_member_budget' param on `/team/update`

    enables budget working across all team members

commit 512999f124
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 16:20:04 2025 -0700

    test: add unit tests for default team member budget

commit 90fa3f61a2
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 15:37:51 2025 -0700

    feat(team_endpoints.py): support using default team member budget id, if set

    allows all team members to use the same budget id

commit acef5324b1
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 15:22:30 2025 -0700

    feat(team_endpoints.py): support `team_member_budget` param on `/team/new`

    Allow creating 1 budget for all users within team (makes it easier to increase/reduce budget if needed for all team members)

commit 2e867ac70f
Author: Krrish Dholakia <krrishdholakia@gmail.com>
Date:   Fri Jun 20 13:45:06 2025 -0700

    fix(ui_sso.py): ensure user is added to team, if set via default internal settings

    allows users signed up via SSO to be added to default team
2025-06-20 23:11:53 -07:00
Ishaan Jaff
7504d6ecae ui new build 2025-06-20 18:37:27 -07:00
Ishaan Jaff
dc2c1122bf
[Feat] UI QA: Pass through endpoints (#11939)
* use ID for pass through management

* use id for pass through

* fix columns

* fix PassThroughInfoView

* cleanup

* working edit and delete pass through

* fix rendering id for pt row

* fixes for pt info view

* working delete pass through

* fix use NumericalInput

* fix alignment

* qa - creating pt

* show route preview

* fix show just 1 msg

* test_create_pass_through_endpoint

* fix ui linting
2025-06-20 18:35:38 -07:00
Ishaan Jaff
99d851544a
[Feat] Add Azure Codex Models on LiteLLM + new /v1 preview Azure OpenAI API (#11934)
* fix get_complete_url

* fixes _is_azure_v1_api_version

* test_azure_responses_api_preview_api_version

* TestAzureResponsesAPIConfig

* add azure/codex-mini

* fix azure/codex-mini

* Update litellm/llms/azure/responses/transformation.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix linting

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-06-20 18:08:44 -07:00
Ishaan Jaff
75298af605
[Bug Fix] Cost tracking and logging via the /v1/messages API are not working when using Claude Code (#11928)
* add test_anthropic_messages_litellm_router_streaming_with_logging to base tests

* move test

* fixes for base ant tests

* working bedrock ant logging

* use BaseAnthropicMessagesStreamingIterator

* use common iterator for messages streaming

* TestAnthropicDirectAPI

* test_anthropic_claude3_transformation.py

* fix code QA checks

* fix logging for anthropic messages in SLP

* fix TestAnthropicOpenAIAPI

* remove hard coded usage for adapter

* test_anthropic_messages_litellm_router_streaming_with_logging
2025-06-20 18:08:35 -07:00
Ishaan Jaff
931b2e4875
[Bug Fix] Fix model_group tracked for /v1/messages and /moderations (#11933)
* fixes _get_router_metadata_variable_name

* fixes _update_kwargs_before_fallbacks

* test_anthropic_messages_litellm_router_non_streaming_with_logging

* test_moderations_api_logging

* fix _pass_through_moderation_endpoint_factory
2025-06-20 14:51:50 -07:00
frank
0d486120bc
add ciphers in command and pass to hypercorn for proxy (#11916)
Signed-off-by: frankzye1 <frankzye@qq.com>
2025-06-20 14:45:48 -07:00
John Tong
c36d0f667b
Feat/add delete callback (#11654)
* feat(delete callback): add api and ui for deleting logging callbacks

* hotfix(delete callback): hotfix lint error

* move test case to test_litellm folder

* fix test case to use mock prisma client
2025-06-20 13:50:37 -07:00
Ishaan Jaff
2a698062e3
[Feat] UI Allow testing /v1/messages on the Test Key Page (#11930)
* Add ANTHROPIC_MESSAGES to chat UI

* add anthropic-ai/sdk

* add anthropic messages to UI

* add makeAnthropicMessagesRequest

* fixes for endpoint selector
2025-06-20 13:31:24 -07:00
Ishaan Jaff
cfee865f16 fix test MCP 2025-06-20 12:09:45 -07:00
Ishaan Jaff
19f13c842f
add gemini-2.5-pro (#11927) 2025-06-20 11:29:06 -07:00