scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-11 22:51:28 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 124
46618 commits 2327 branches 1406 tags 2.4 GiB
Commit graph

4669 commits

Author SHA1 Message Date
Krish Dholakia
3095f43e92
Merge pull request #15007 from TobiMayr/feature/add-max-requests-env-var 
feature/add max requests env var
 2025-10-03 15:30:15 -07:00
rishiganesh2002
d36c8d6bbe
[Feat] MCP Gateway Fine-grained Tools Addition (#15153) 
* feat: UI to add specific tools under creating MCP connection

* chore: pydantic + prisma changes

* feat: adding specific MCP tools now works

* fix: allowed tools filtering

* chore: filtered list to mcp server cost config

* chore: update Readme

* chore: refactor the filtering

* test: Added tests

When the allowed_tests is null, empty list or populated

* chore: resolve the proxy issue

* feat: updating MCP tool filtering
 2025-10-03 10:16:29 -07:00
Ishaan Jaff
d538cf489a
[Feat] Fixes to dynamic rate limiter v3 - add saturatation detection (#15119) 
* test cases dynamic rate limits

* fix _handle_generous_mode

* docs add readme

* use configs for vars

* fix debug

* add comment

* test_dynamic_rate_limiter_v3.py

* test_concurrent_pre_call_hooks_stress
 2025-10-01 18:35:34 -07:00
Krrish Dholakia
757436f302 test: add unit test 2025-10-01 17:51:10 -07:00
Krrish Dholakia
a83238a2db test: add unit tests 2025-10-01 17:02:05 -07:00
Ishaan Jaff
388761f52d
[Fix] LiteLLM UI - Ensure OTEL settings are saved in DB after set on UI (#15118) 
* fix: fix _add_callback_from_db_to_in_memory_litellm_callbacks

* test_add_callback_from_db_to_in_memory_litellm_callbacks

* fix otel

* fix: fix _add_callback_from_db_to_in_memory_litellm_callbacks
 2025-10-01 15:33:22 -07:00
Ishaan Jaff
e73d053de3
[Fix] Proxy Auth - Ensure LLM_API_KEYs can access pass through routes (#15115) 
* test_virtual_key_llm_api_routes_allows_registered_pass_through_endpoints

* fix: is_registered_pass_through_route

* docs fix
 2025-10-01 14:09:01 -07:00
Sameer Kankute
7ec7e5332c
Add generateContent cost tracking (#15014) 2025-10-01 09:03:45 -07:00
Krish Dholakia
1503435d91
Merge pull request #15029 from henryhwang/gemini-adapter-fixes 
feat(gemini): Add full support for native Gemini API translation
 2025-09-30 21:19:18 -07:00
Ishaan Jaff
73bfef1a1f
Revert "[Feature]: Replace HTTPException with ParallelRequestLimitError in pa…" (#15095) 
This reverts commit 71b9b58fa9.
 2025-09-30 21:17:04 -07:00
Henry Wang
acc23b9757 fix issue from pr review 2025-10-01 11:57:10 +08:00
Henry H Wang
7c4439ba0a
Merge branch 'BerriAI:main' into gemini-adapter-fixes 2025-10-01 09:53:51 +08:00
Krish Dholakia
c475723c67
Merge pull request #15044 from BerriAI/litellm_dev_09_29_2025_p1 
MCP - enforce server permissions on call tools + Teams - add model specific tpm/rpm limits to teams on LiteLLM
 2025-09-30 15:32:53 -07:00
Krish Dholakia
5619d350b6
Merge pull request #15074 from Jetemple/custom-logo-fix 
Make UI theme settings publicly accessible for custom branding
 2025-09-30 15:26:00 -07:00
Ishaan Jaff
0476a33d9f
[Bug Fix] Passthrough API Endpoints - Ensure query params are forwarded from origin url to downstream request (#15087) 
* test_pass_through_request_query_params_forwarding

* fix: pass_through_request

* test_azure_openai_assistants_e2e_operations_stream

* test_azure_openai_assistants_e2e_operations_stream
 2025-09-30 15:01:38 -07:00
Ishaan Jaff
69a464fc97
[Fix Security] Ensure OCI secret fields not shared on /models and /v1/models endpoints (#15085) 
* fix: remove_sensitive_info_from_deployment

* fix: remove_sensitive_info_from_deployment

* test_model_info_v1_oci_secrets_not_leaked
 2025-09-30 14:55:54 -07:00
Copilot
71b9b58fa9
[Feature]: Replace HTTPException with ParallelRequestLimitError in parallel_request_limiter_v3 (#15033) 
* Initial plan

* Implement ParallelRequestLimitError custom exception to replace HTTPException

Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>

* Add ParallelRequestLimitError to litellm main module exports

Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
 2025-09-30 13:57:14 -07:00
Krrish Dholakia
0cd61a6a6a fix: simplify testing 2025-09-30 12:37:25 -07:00
Jack Temple
7212116d8c test: add UI theme settings retrieval and update tests 2025-09-30 10:01:44 -05:00
Henry Wang
d838c96ffb fix test issues from pr review 2025-09-30 16:05:17 +08:00
Copilot
f22fd4cddd
Fix: Add /v1/messages/count_tokens to Anthropic routes for non-admin user access (#15034) 
* Initial plan

* Fix: Add /v1/messages/count_tokens to Anthropic routes for user access

Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
 2025-09-29 18:16:52 -07:00
Ishaan Jaff
ebf72f5eb9
[Fix] Parallel Request Limiter v3 - use well known redis cluster hashing algorithm (#15052) 
* test_keyslot_for_redis_cluster

* fix _is_redis_cluster

* Update litellm/proxy/hooks/parallel_request_limiter_v3.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-09-29 18:12:44 -07:00
Ishaan Jaffer
f303860881 Revert "test_keyslot_for_redis_cluster" 
This reverts commit 52de33787b.
 2025-09-29 16:42:15 -07:00
Ishaan Jaffer
52de33787b test_keyslot_for_redis_cluster 2025-09-29 16:41:32 -07:00
Krrish Dholakia
9ed83d44e3 test: remove unnecessary test 2025-09-29 13:35:34 -07:00
Sameer Kankute
3ab1c31e4e
(Feat) Add cost tracking for Vertex AI Passthrough /predict endpoint (#15019) 
* Add cost tracking for passthrough for predict endpoint

* restore file
 2025-09-29 13:19:04 -07:00
Krrish Dholakia
bc6e6e7a28 fix(auth_checks.py): add auth checks to mcp server on call tools 2025-09-29 13:13:10 -07:00
Henry Wang
99a884019b test(gemini): Add unit tests for Google GenAI adapter 
This commit adds a comprehensive suite of unit tests for the Google GenAI adapter to ensure compliance with the project's contribution guidelines.

The new tests cover four main areas:
- Request parameter translation
- Streaming response handling
- Router methods for Google GenAI
- Proxy endpoints for Google GenAI

Additionally, this commit includes minor formatting and linting fixes identified during development.
 2025-09-29 18:51:35 +08:00
Krish Dholakia
0d738b2899
Merge pull request #14986 from uc4w6c/fix/remove-servername-prefix-mcp_tools-tests 
Fix/remove servername prefix mcp tools tests
 2025-09-28 18:00:23 -07:00
Krrish Dholakia
f32b0364c4 fix: fix tests 2025-09-28 17:55:46 -07:00
Yuta Saito
dae7d08ff2 Revert "Revert "Merge pull request #14720 from uc4w6c/feat/remove-servername-prefix-mcp_tools"" 
This reverts commit a88d774f94.
 2025-09-29 07:12:24 +09:00
TobiMayr
3c99d2236a feature/add max requests env var 2025-09-28 19:18:56 +01:00
Krish Dholakia
c328b4a036
Merge pull request #15002 from BerriAI/litellm_dev_09_27_2025_p3 
MCP - specify forwardable headers, specify allowed/disallowed tools for MCP servers
 2025-09-28 09:21:52 -07:00
Krrish Dholakia
53d0cbb1b7 fix: update tests + logic for passing multiple headers 2025-09-28 09:09:11 -07:00
Krrish Dholakia
526156ed9d feat(mcp/): allows admin to prevent llm's from accidentally deleting github repo's even if user is allowed to do this 2025-09-27 19:36:11 -07:00
Ishaan Jaffer
35c14f7178 Revert "Merge pull request #14821 from hazyone/fix-13380" 
This reverts commit 37ea89eff0, reversing
changes made to aede742db5.
 2025-09-27 18:52:59 -07:00
Krrish Dholakia
0ff7177373 feat(user_api_key_auth_mcp.py): pass extra headers from clientside straight through - allow multiple clientside headers 
Closes LIT-952
 2025-09-27 17:11:06 -07:00
Krish Dholakia
3e3e3837a1
Merge branch 'main' into litellm_dev_09_24_2025_p1 2025-09-27 11:21:07 -07:00
Krrish Dholakia
5cdeb63cdd test: fix tests 2025-09-27 11:09:25 -07:00
Krrish Dholakia
7278ae5305 test: fix tests 2025-09-27 10:03:54 -07:00
Krrish Dholakia
ac09d29c0e test(tests/): add unit test to confirm oauth2 headers forwarded on receipt 2025-09-27 09:30:07 -07:00
Ishaan Jaff
36cc98254c
[Fix] Parallel Request Limiter v3 - ensure Lua scripts can execute on redis cluster (#14968) 
* use hashtag slots for rate limiting logic

* redis_startup_nodes fix

* test_execute_redis_batch_rate_limiter_script_cluster_compatibility

* async_increment_tokens_with_ttl_preservation
 2025-09-26 18:15:57 -07:00
Ishaan Jaff
628cd13755
[Feat] UI - Allow scheduling key rotations when creating virtual keys (#14960) 
* fix design of key reset interval

* fix: LiteLLM_VerificationToken

* fix key manager

* add key_rotation_at

* ui fix

* fix ui view

* set key_rotation_at  on creation

* add key_rotation_at

* fix info

* fix: _set_key_rotation_fields

* fix KeyRotationManager

* fix key edit view

* test_update_key_fn_auto_rotate_enable

* fix KeyRotationManager
 2025-09-26 16:24:40 -07:00
Ishaan Jaff
ea8d0bb7d5 fix: re-add scheduled rotations 2025-09-26 11:40:46 -07:00
Ishaan Jaffer
539d10f9cb test fix 2025-09-26 11:06:26 -07:00
Alexsander Hamir
eaa04cd8ce
fix: use fastuuid helper (#14903) 
* fix: use fastuuid helper across the codebase

First batch of changes, simple drop in replacement.

* second batch of changes

* fixed: script mistake on helper file
 2025-09-25 15:47:01 -07:00
Arshdeep Singh
471f011ae5 fix: add return type annotation for full mypy compliance 2025-09-25 12:52:12 -04:00
Arshdeep Singh
8193f56876 fix: remove print statement to pass ruff linting checks 2025-09-25 12:39:49 -04:00
Arshdeep Singh
39683cc3d8 fix: remove unused custom_recognizers variable to pass linting 2025-09-25 12:31:08 -04:00
Arshdeep Singh
8364da014f style: format code with black 2025-09-25 12:23:44 -04:00