Ishaan Jaff
c59a0c9681
[Feat] UI - Allow setting cache settings on UI ( #16143 )
...
* add LiteLLM_CacheConfig
* add CacheSettingsField
* add UI cache saver
* feat add cache_settings_router
* fix schema
* fix ssl_check_hostname
* refactor into utils
* add groups for field names
* add test_connection in base cache
* add test_connection inredis and redis cluster
* feat _decrypt_db_variables
* add cache settings endpoints
* test_test_cache_connection_calls_cache_test_connection_with_params
* fix: add switch_on_llm_response_caching
* feat use CacheSettingsManager
* feat use CacheSettingsManager
* TestCacheSettingsManager
* fix update_config
* Cache Field test
2025-10-31 17:43:59 -07:00
YutaSaito
8b33328cc1
Perf speed up pytest ( #15951 )
...
* perf: Skip sleep delays in base_mail.py during tests to improve test speed
* perf: Mock datetime.now in parallel_request_limiter_v3.py to improve test speed
* pref: Mock urllib system calls in test_aiohttp_transport.py to improve test speed
* chore: add --durations=50 to visualize slowest tests
* pref: reduce setup phase overhead by widening fixture scope in conftest.py
* test: stabilize flaky tests
* fix: minor issue
2025-10-27 19:43:40 -07:00
Krish Dholakia
6bb1d77f45
Org level tpm/rpm limits + Team tpm/rpm validation when assigned to org ( #15549 )
...
* fix(support-model-specific-tpm/rpm-limits): Allows setting rate limits by tpm/rpm for models by team
* fix(key_management_endpoints.py): enforce guaranteed throughput with key-level model tpm/rpm limits, when team-level tpm/rpm limits are set
* test: add unit testing
* feat(schema.prisma): add metadata to litellm budget table
* feat(proxy/utils.py): add org limits to user api key auth
allows org level tpm/rpm limiting to work
* feat: add org level tpm/rpm limits + inherit org id in key from team
enables org level tpm/rpm limits
* feat: validated working org tpm/rpm limits
* feat: support updating org level, model specific tpm/rpm limits
* fix: working key validation for org level tpm/rpm limits
* fix: working validation for orgs when giving tpm/rpm to teams
* fix(key_management_endpoints.py): fix tpm/rpm limits on orgs
* fix(key_management_endpoints.py): support limits
* refactor: remove duplicate var
* fix: refactor to avoid ruff errors
* fix: fix typign
* fix: fix linting error
* fix: fix testing
* fix(key_management_endpoints.py): document params
2025-10-25 13:40:29 -07:00
Krish Dholakia
4e141df03a
(feat) Team level model-specific tpm/rpm limits + working key-level validation of tpm/rpm limit when assigned to team ( #15513 )
...
* fix(support-model-specific-tpm/rpm-limits): Allows setting rate limits by tpm/rpm for models by team
* fix(key_management_endpoints.py): enforce guaranteed throughput with key-level model tpm/rpm limits, when team-level tpm/rpm limits are set
* test: add unit testing
* fix: fix minor linting errors
* fix: refactor
2025-10-18 13:14:04 -07:00
Ishaan Jaffer
ea69f4547d
Merge branch 'main' into litellm_oct_staging2
2025-10-16 17:06:29 -07:00
Ishaan Jaff
f27f2d4803
Merge branch 'main' into litellm_sso_add_pkce
2025-10-16 15:48:01 -07:00
Krrish Dholakia
e43c3b9b88
test: add unit testing
2025-10-16 15:37:26 -07:00
Ishaan Jaffer
086904f3db
TestPKCEFunctionality
2025-10-16 13:18:31 -07:00
berri-teddy
1b55803c76
test: reduce EntraID app roles tests to essential scenarios
...
- Keep only 2 focused tests: single role extraction and no roles claim
- Remove complex fixtures and edge case tests
- Maintain clean, maintainable test coverage
2025-10-15 18:15:04 -07:00
berri-teddy
6b166e046d
fix: correct EntraID app roles JWT claim extraction
...
- Fix get_app_roles_from_id_token to use 'app_roles' claim instead of 'roles'
- Add comprehensive unit tests for EntraID app roles functionality
- Prevent regressions in Microsoft EntraID SSO authentication
Resolves issue where EntraID app roles were not being extracted correctly
from JWT tokens, causing authentication failures for users with assigned
app roles in Microsoft EntraID.
2025-10-15 18:06:03 -07:00
Ishaan Jaff
5b7e2fd778
[Feat] UI - Allow setting Provider Discounts on UI ( #15550 )
...
* fix cost_discount_config
* add CostBreakdown
* fix: set_cost_breakdown
* test_cost_discount_vertex_ai
* docs fix
* docs fix discounts
* docs fix
* docs custom pricing
* docs fix
* fixes for getting cost breakdown in response headers
* test - response headers wth discount
* - feat: allow setting cost tracking settings
* add cost tracking endpoints
* feat add cost_tracking_settings_router
* add validation when setting cost settings
* add CostTrackingSettings
* add page
* refactor
* use simple table
* add ProviderDiscountTable
* fix ui
* save
* fix: discount settings
* fix edits
* add settings
* add HelpLink
* add help link
* docs HelpLink
* docs fix
* fix how it works
* fix layout
* test TestCostTrackingSettings
* fix Dict
2025-10-14 20:08:18 -07:00
Ishaan Jaffer
a163bf9f51
test fix: MicrosoftSSOHandler
2025-10-11 08:55:23 -07:00
Ishaan Jaffer
3aa0f6ed72
test_generate_key_with_object_permission
2025-10-11 08:54:15 -07:00
Ishaan Jaffer
87719640eb
test tag mgmt
2025-10-11 08:48:37 -07:00
Copilot
b9eb05ea63
[Feature]: Include server_name in /v1/mcp/server/health endpoint response ( #15431 )
...
* Initial plan
* Add server_name to MCP health check response
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
2025-10-10 17:37:53 -07:00
Ishaan Jaffer
c4022ade49
test mapped tests MCP
2025-10-08 18:34:30 -07:00
Ishaan Jaffer
e1ab3620ee
fix: mapped tests
2025-10-07 17:55:52 -07:00
Ishaan Jaff
7b56ba240e
[MCP Gateway] Litellm mcp fixes team control ( #15304 )
...
* fix: _set_object_permission
* fix: _set_object_permission on teams
* fix: _set_object_permission
* fixes for team/key permissions
* statsh: object permission view
* fix: MCPServerPermissions
2025-10-07 16:48:00 -07:00
Ishaan Jaff
bc26eff98f
Fix: Make PATCH /model/{model_id}/update handle team_id consistently with POST /model/new ( #15297 )
...
* fix: _update_team_model_in_db
* test_patch_model_with_team_id_creates_proper_setup
2025-10-07 14:04:08 -07:00
Ishaan Jaff
07a17d6d6b
[Feat] Proxy CLI - dont store existing key in the URL, store it in the state param ( #15290 )
...
* Feat: CLI Auth fixes for UI SSO
* fix auth.py
* fix test ui sso.py
2025-10-07 12:36:17 -07:00
Ishaan Jaff
930f88078e
[MCP Gateway] Backend - Allow storing allowed tools by team/key ( #15243 )
...
* add mcp_tool_permissions column to LiteLLM_ObjectPermissionTable
* add mcp_tool_permissions
* add LiteLLM_ObjectPermissionTable
* test key/team mgmt
* fix code QA check
* fix check_tool_permission_for_key_team
* test_key_tool_permission_allows_permitted_tool
* test_list_tools_filters_by_key_team_permissions
* fix _get_tools_from_mcp_servers
* fix logger.debug
* fix check_tool_permission_for_key_team
* fix: filter_tools_by_key_team_permissions
* fix _get_team_object_permission
* fix _set_object_permission
* fix handle_update_object_permission_common
* fix add allowed tools to keys
* test add key/team level tool permissions for MCPs
2025-10-06 18:49:32 -07:00
Krrish Dholakia
63cb2764fe
test: fix raise
2025-10-04 16:11:22 -07:00
Krrish Dholakia
814e49df06
test: update tests
2025-10-04 14:39:50 -07:00
Krrish Dholakia
757436f302
test: add unit test
2025-10-01 17:51:10 -07:00
Krrish Dholakia
a83238a2db
test: add unit tests
2025-10-01 17:02:05 -07:00
Ishaan Jaff
628cd13755
[Feat] UI - Allow scheduling key rotations when creating virtual keys ( #14960 )
...
* fix design of key reset interval
* fix: LiteLLM_VerificationToken
* fix key manager
* add key_rotation_at
* ui fix
* fix ui view
* set key_rotation_at on creation
* add key_rotation_at
* fix info
* fix: _set_key_rotation_fields
* fix KeyRotationManager
* fix key edit view
* test_update_key_fn_auto_rotate_enable
* fix KeyRotationManager
2025-09-26 16:24:40 -07:00
Ishaan Jaff
ea8d0bb7d5
fix: re-add scheduled rotations
2025-09-26 11:40:46 -07:00
Alexsander Hamir
eaa04cd8ce
fix: use fastuuid helper ( #14903 )
...
* fix: use fastuuid helper across the codebase
First batch of changes, simple drop in replacement.
* second batch of changes
* fixed: script mistake on helper file
2025-09-25 15:47:01 -07:00
Ishaan Jaffer
b1e56c55ad
merge
2025-09-24 22:11:37 -07:00
Ishaan Jaff
ded823a3a3
[Feat] Initial support for scheduled key rotations ( #14877 )
...
* add KeyRotationSettings
* add KeyRotationManager
* add key rotation manager
* add KeyRotationManager
* fix _initialize_spend_tracking_background_jobs
* fix add_key_rotation_fields
* fixes
* new fields in schema
* update schema
* fix fixes for init key rotation manager
* fixes for init key rotation manager
* fix KeyRotationManager
* tests for key rotation
* fix key_rotation_settings
* fix KeyRotationManager
* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS
* fix fixes for init key rotation manager
* ruff check fix
* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS
* fix _initialize_spend_tracking_background_jobs
* docs fix
* docs auto rotate
* schema fix
* bump proxy extras
* fix config.yml
2025-09-24 21:37:56 -07:00
Ishaan Jaff
f4ecf3ca72
[Feat] Fixes for LiteLLM Proxy CLI to Auth to Gateway ( #14836 )
...
* fix: error msg from updating key
* fix _create_new_cli_key
* fix validate_key_team_change
* fix interface for chat
* ruff fix
* fix auth for keys
* get_litellm_gateway_api_key
* fix chat
* test fix
* linting fix
* fix mypy
* test_validate_key_team_change_with_member_permissions
2025-09-23 19:43:32 -07:00
Ishaan Jaffer
79a6feb7ac
generate_mock_mcp_server_config_record
2025-09-23 17:33:11 -07:00
Ishaan Jaffer
5fc70396ad
test fix
2025-09-23 15:50:11 -07:00
Ishaan Jaffer
7e64df92a5
test_cli_sso_callback_regenerate_existing_key
2025-09-23 15:42:07 -07:00
Ishaan Jaffer
bb6fb445c0
ui test fix
2025-09-23 14:34:08 -07:00
Ishaan Jaff
fa20abfe48
[Feat] Proxy CLI Auth - Allow re-using cli auth token ( #14780 )
...
* fix: cli auth with SSO okta
* fix: add LITTELM_CLI_SERVICE_ACCOUNT_NAME
* fix: get_litellm_cli_user_api_key_auth
* use existing_key CLI
* fix: use existing key
* test auth commands
* test_cli_sso_callback_regenerate_vs_create_flow
2025-09-22 10:07:16 -07:00
Krrish Dholakia
7694e9f6a9
test: refactoring + testing
2025-09-19 17:20:15 -07:00
Yuta Saito
7f8b1d0708
test: fix failing tests after conflict resolution
2025-09-19 07:48:37 +09:00
Yuta Saito
654f1d3290
fix: stop including spec_version in MCP server registration inserts
2025-09-19 07:06:15 +09:00
Yuta Saito
6c291093e9
fix: remove adding Mcp-Protocol-Version header ( #14069 )
...
The Mcp-Protocol-Version header is already handled in the MCP Python SDK, so the explicit addition on LiteLLM Proxy was redundant.
2025-09-19 07:05:20 +09:00
Krrish Dholakia
32f634e305
test: add unit testing
2025-09-16 16:54:03 -07:00
Ishaan Jaff
8e22cf5d65
[Fix] /responses API - add cancel endpoint + allow non-admins to use this as an llm api endpoint ( #14594 )
...
* fix: ensure /responses/cancel works for non admins
* test: cancel endpoint
* fix responses API cancel endpoint
* test fix
* TestGoogleAIStudioResponsesAPITest
2025-09-15 18:49:54 -07:00
Ishaan Jaff
cebacd65cf
[Bug Fix] SCIM v2 - ensure group PUSH and PUT ops allow creating non-existent members ( #14581 )
...
* fix: scim handle non existent members
* test - scim v2
* test fix
* fix: NewUserResponse
2025-09-15 11:27:05 -07:00
Krrish Dholakia
2c6481fa33
fix: remove incorrect test
2025-09-14 09:34:31 -07:00
Ishaan Jaff
6172145014
fix: org budget update fix ( #14541 )
2025-09-13 16:34:26 -07:00
Krrish Dholakia
0c8b311155
test: add unit testing for both flows on key unblock
2025-09-11 19:15:15 -07:00
Krish Dholakia
fbc0ec98b6
Merge pull request #12438 from jasonpnnl/fix-customer-update
...
Fix 500 error in `/customer/update` endpoint when updating with `budget_id`
2025-09-06 22:12:30 -07:00
Ishaan Jaff
379b0dbf14
[Fix] Ensure team_id is a required field for generating service account keys ( #14270 )
...
* generate_service_account_key_fn
* fix validate_team_id_used_in_service_account_request
* fix types
* test_validate_team_id_used_in_service_account_request_requires_team_id
2025-09-04 18:14:38 -07:00
22mSqRi
25afa67616
fix: Key Budget not resets at expectable times
2025-09-04 09:04:01 +00:00
Ishaan Jaff
beb300abae
[Fix] SCIM - Bug fixes for handling SCIM Group Memberships ( #14226 )
...
* Feat: add better SCIM debugging
* fix _get_scim_member_display
* fix patch_group
* test_update_group_e2e
* test_get_scim_member_value
2025-09-03 16:15:51 -07:00
