Ishaan Jaffer
87719640eb
test tag mgmt
2025-10-11 08:48:37 -07:00
Ishaan Jaffer
9bde1c1a4c
TestEnkryptAIGuardrailHooks
2025-10-10 19:59:41 -07:00
Ishaan Jaff
527c8f59fa
[Feat] Tag Management - Add support for setting tag based budgets ( #15433 )
...
* feat: add LiteLLM_TagTable
* fix: use new table for tag management
* fix - allow setting budgets for tags
* working tag creation
* fix schema.prisma
* add tag info
* ui fixes
* ui fix tag info
* TAG_CACHE_IN_MEMORY_TTL_SECONDS
* add Litellm_EntityType
* fix get_aggregated_db_spend_update_transactions
* fix: _update_entity_spend_in_db
* fix _tag_max_budget_check
* add tag budget check
* add tag_list_transactions
* test_get_tag_objects_batch
* test_update_tag_db_without_prisma_client
* fix get_tags_from_request_body
* get_tags_from_request_body
* fix get_tags_from_request_body
* fix spend tracking utils
* get_tags_from_request_body
* test_get_tags_from_request_body_with_metadata_tags
* feat: add _update_tag_cache spend tracking
* fix _PROXY_track_cost_callback
* test_tag_cache_update_multiple_tags
* fix tag info
* docs fix
* docs tag budgets
* doc fix
* docs fix
* fix tag budget
* docs tag budgets
* docs fix
* ruff fix
2025-10-10 19:24:50 -07:00
Copilot
b9eb05ea63
[Feature]: Include server_name in /v1/mcp/server/health endpoint response ( #15431 )
...
* Initial plan
* Add server_name to MCP health check response
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
2025-10-10 17:37:53 -07:00
Krish Dholakia
611a876889
Merge pull request #15380 from BerriAI/litellm_shared_heatlh_status
...
Implement Shared Health Check State Across Pods
2025-10-09 22:25:45 -07:00
Krrish Dholakia
f2d4f03339
feat(pass_through_endpoints.py): only show available pass through endpoints based on what teams has access to
...
makes it easier to control access
2025-10-09 17:45:14 -07:00
Krish Dholakia
eb0b263532
Merge pull request #15340 from BerriAI/litellm_db_config_accidental_override_fix
...
fix: Prevents DB from accidentally overriding config file values if they are empty in DB
2025-10-09 17:31:59 -07:00
Krrish Dholakia
5aa5a3b425
fix(route_checks.py): support team metadata
2025-10-09 17:18:38 -07:00
Ishaan Jaff
6cf57d85c3
[Feat] Add EnkryptAI Guardrails on LiteLLM ( #15390 )
...
* feat: add EnkryptAIGuardrail
* fix types
* fix EnkryptAIGuardrails
* __all__ = ["EnkryptAIGuardrail"]
fix
* fix EnkryptAIGuardrail
* TestEnkryptAIExtraction
* fix mypy linting
* docs enkrypt ai
* add EnkryptAIGuardrailConfigModel
* fix EnkryptAIGuardrailConfigModel
* fix import struct
* fix EnkryptAIGuardrails
2025-10-09 16:27:04 -07:00
Krrish Dholakia
ace862189c
test(test_mcp_server_manager.py): add unit testing
2025-10-09 14:52:46 -07:00
Sameer Kankute
dce6cd1051
Add shared healthcheck
2025-10-09 22:18:05 +05:30
Achintya Rajan
169c1f0f21
moved test to test_proxy_server
2025-10-08 19:24:16 -07:00
Krish Dholakia
d921df1baf
Merge pull request #15343 from BerriAI/litellm_dev_10_08_2025_p1
...
MCP - support converting OpenAPI specs to MCP servers
2025-10-08 19:10:04 -07:00
Ishaan Jaffer
c4022ade49
test mapped tests MCP
2025-10-08 18:34:30 -07:00
Achintya Rajan
4bebb57611
moved test to test_litellm
2025-10-08 18:28:10 -07:00
Krrish Dholakia
cd13e533a2
feat(mcp_server_manager.py): expand allowed/disallowed list
2025-10-08 16:06:17 -07:00
Krrish Dholakia
28698933fc
feat(mcp_server_manager.py): ensure list tools for openapi servers works as expected
2025-10-08 15:59:42 -07:00
Ishaan Jaffer
e1ab3620ee
fix: mapped tests
2025-10-07 17:55:52 -07:00
Ishaan Jaff
36c971a6fd
[MCP Gateway] QA/Fixes - Ensure Team/Key level enforcement works for MCPs ( #15305 )
...
* fix: _set_object_permission
* fix: _set_object_permission on teams
* fix: _set_object_permission
* fixes for team/key permissions
* statsh: object permission view
* fix: MCPServerPermissions
* fix: _get_team_object_permission
* test mcp checks for permissions
* fix server checks with prefix names
* test_list_tools_strips_prefix_when_matching_permissions
* ruff fix
* docs - refactor MCP
* docs update MCP docs
* docs allowed tools
2025-10-07 17:34:48 -07:00
Ishaan Jaff
7b56ba240e
[MCP Gateway] Litellm mcp fixes team control ( #15304 )
...
* fix: _set_object_permission
* fix: _set_object_permission on teams
* fix: _set_object_permission
* fixes for team/key permissions
* statsh: object permission view
* fix: MCPServerPermissions
2025-10-07 16:48:00 -07:00
Ishaan Jaff
bc26eff98f
Fix: Make PATCH /model/{model_id}/update handle team_id consistently with POST /model/new ( #15297 )
...
* fix: _update_team_model_in_db
* test_patch_model_with_team_id_creates_proper_setup
2025-10-07 14:04:08 -07:00
Ishaan Jaff
07a17d6d6b
[Feat] Proxy CLI - dont store existing key in the URL, store it in the state param ( #15290 )
...
* Feat: CLI Auth fixes for UI SSO
* fix auth.py
* fix test ui sso.py
2025-10-07 12:36:17 -07:00
Sameer Kankute
e4892735f0
fix gemini cli by actually streaming the response ( #15264 )
...
* fix gemini cli by actually streaming the response
* fix cost tracking
* fix test
2025-10-07 11:26:39 -07:00
Ishaan Jaff
1d468a59f3
[MCP Gateway] Fine-grained Database Object Storage Control ( #15255 )
...
* add supported_db_objects
* add _should_load_db_object
* add docs on storing MCP objects in DB
* test_should_load_db_object_with_supported_db_objects
* type fix
2025-10-06 19:31:44 -07:00
Ishaan Jaff
930f88078e
[MCP Gateway] Backend - Allow storing allowed tools by team/key ( #15243 )
...
* add mcp_tool_permissions column to LiteLLM_ObjectPermissionTable
* add mcp_tool_permissions
* add LiteLLM_ObjectPermissionTable
* test key/team mgmt
* fix code QA check
* fix check_tool_permission_for_key_team
* test_key_tool_permission_allows_permitted_tool
* test_list_tools_filters_by_key_team_permissions
* fix _get_tools_from_mcp_servers
* fix logger.debug
* fix check_tool_permission_for_key_team
* fix: filter_tools_by_key_team_permissions
* fix _get_team_object_permission
* fix _set_object_permission
* fix handle_update_object_permission_common
* fix add allowed tools to keys
* test add key/team level tool permissions for MCPs
2025-10-06 18:49:32 -07:00
Krrish Dholakia
63cb2764fe
test: fix raise
2025-10-04 16:11:22 -07:00
Krrish Dholakia
2d1000c461
test: update tests
2025-10-04 15:31:25 -07:00
Krish Dholakia
a9037ab61f
Merge branch 'main' into litellm_dev_10_03_2025_p1
2025-10-04 15:23:31 -07:00
Krish Dholakia
75e3f4e10d
Merge pull request #15120 from BerriAI/litellm_dev_10_01_2025_p2
...
(feat) Support 'guaranteed_throughput' when setting limits on keys belonging to a team
2025-10-04 15:22:47 -07:00
Krrish Dholakia
814e49df06
test: update tests
2025-10-04 14:39:50 -07:00
Ishaan Jaff
ec9cdf783a
Revert "Add streamGenerateContent cost tracking in passthrough ( #15199 )" ( #15202 )
...
This reverts commit 8095de506a
2025-10-04 14:37:02 -07:00
Sameer Kankute
8095de506a
Add streamGenerateContent cost tracking in passthrough ( #15199 )
...
* Add streamgenerate cost tracking for gemini provider
* add cost tracking test
2025-10-04 12:31:25 -07:00
Ishaan Jaffer
c38c5d20cc
test dynamic rate limiter 3
2025-10-04 12:06:13 -07:00
Ishaan Jaff
f78608082c
[Feat] Dynamic Rate Limiter v3 - fixes for detecting saturation + fixes for post saturation behavior ( #15192 )
...
* fix: test case 1, model hits saturation
* fix: _check_rate_limits test case 2
* fix: _get_priority_allocation
* test_default_priority_shared_pool
* fix: No Rate Limiting when low saturatation
* fix: correctly use model_saturation_check
* fixes priority_descriptors
* fix: tune default PriorityReservationSettings
2025-10-04 10:45:17 -07:00
Krrish Dholakia
3816d3b36f
test: add unit testing
2025-10-03 17:27:49 -07:00
Krrish Dholakia
c043ad6c2b
fix: replace list in for set in
...
faster
2025-10-03 17:17:20 -07:00
Krrish Dholakia
69edc546c0
fix(mcp_server_manager.py): don't return an invalid server id on list servers
...
Prevents user from hitting 'server not found' error, even when they see it being listed on litellm ui
2025-10-03 17:15:15 -07:00
Yuta Saito
359aaa947f
test: fix test_mcp_server.py
2025-10-04 08:18:15 +09:00
Krish Dholakia
3095f43e92
Merge pull request #15007 from TobiMayr/feature/add-max-requests-env-var
...
feature/add max requests env var
2025-10-03 15:30:15 -07:00
rishiganesh2002
d36c8d6bbe
[Feat] MCP Gateway Fine-grained Tools Addition ( #15153 )
...
* feat: UI to add specific tools under creating MCP connection
* chore: pydantic + prisma changes
* feat: adding specific MCP tools now works
* fix: allowed tools filtering
* chore: filtered list to mcp server cost config
* chore: update Readme
* chore: refactor the filtering
* test: Added tests
When the allowed_tests is null, empty list or populated
* chore: resolve the proxy issue
* feat: updating MCP tool filtering
2025-10-03 10:16:29 -07:00
Ishaan Jaff
d538cf489a
[Feat] Fixes to dynamic rate limiter v3 - add saturatation detection ( #15119 )
...
* test cases dynamic rate limits
* fix _handle_generous_mode
* docs add readme
* use configs for vars
* fix debug
* add comment
* test_dynamic_rate_limiter_v3.py
* test_concurrent_pre_call_hooks_stress
2025-10-01 18:35:34 -07:00
Krrish Dholakia
757436f302
test: add unit test
2025-10-01 17:51:10 -07:00
Krrish Dholakia
a83238a2db
test: add unit tests
2025-10-01 17:02:05 -07:00
Ishaan Jaff
388761f52d
[Fix] LiteLLM UI - Ensure OTEL settings are saved in DB after set on UI ( #15118 )
...
* fix: fix _add_callback_from_db_to_in_memory_litellm_callbacks
* test_add_callback_from_db_to_in_memory_litellm_callbacks
* fix otel
* fix: fix _add_callback_from_db_to_in_memory_litellm_callbacks
2025-10-01 15:33:22 -07:00
Ishaan Jaff
e73d053de3
[Fix] Proxy Auth - Ensure LLM_API_KEYs can access pass through routes ( #15115 )
...
* test_virtual_key_llm_api_routes_allows_registered_pass_through_endpoints
* fix: is_registered_pass_through_route
* docs fix
2025-10-01 14:09:01 -07:00
Sameer Kankute
7ec7e5332c
Add generateContent cost tracking ( #15014 )
2025-10-01 09:03:45 -07:00
Krish Dholakia
1503435d91
Merge pull request #15029 from henryhwang/gemini-adapter-fixes
...
feat(gemini): Add full support for native Gemini API translation
2025-09-30 21:19:18 -07:00
Ishaan Jaff
73bfef1a1f
Revert "[Feature]: Replace HTTPException with ParallelRequestLimitError in pa…" ( #15095 )
...
This reverts commit 71b9b58fa9
2025-09-30 21:17:04 -07:00
Henry Wang
acc23b9757
fix issue from pr review
2025-10-01 11:57:10 +08:00
Henry H Wang
7c4439ba0a
Merge branch 'BerriAI:main' into gemini-adapter-fixes
2025-10-01 09:53:51 +08:00
