scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-19 00:01:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 88
litellm/litellm/models
History
tin-berri 58de920921
feat(mcp): bound outbound tool-call concurrency per MCP server (#31641) 
Add an optional per-server max_concurrent_requests that caps how many
tool calls LiteLLM sends to one MCP server at once, so batch-processing
backends are not overwhelmed by unbounded parallel dispatch. Excess calls
queue on a per-server asyncio.Semaphore instead of being rejected. Unset
or non-positive means unlimited, preserving existing behavior.

Resolves LIT-2749
2026-07-02 15:33:44 -07:00
..
__init__.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
access_group.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
base.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
budget.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
config.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
credentials.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
end_user.py feat(proxy): type Customer Management response_model for OpenAPI coverage (#31043) 2026-06-30 09:58:01 -07:00
managed_files.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
mcp_server.py feat(mcp): bound outbound tool-call concurrency per MCP server (#31641) 2026-07-02 15:33:44 -07:00
model.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
object_permission.py feat(mcp): add mcp_tool_search virtual tools for large tool catalogs (#31777) 2026-06-30 20:03:59 -07:00
organization.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
organization_membership.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
project.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
skills.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
spend_logs.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
tag.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
team.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
team_membership.py style: unify ruff format width on 120 (#31518) 2026-06-27 12:39:29 -07:00
user.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00
verification_token.py feat(litellm): add models and repository layers (#29686) 2026-06-06 20:59:33 -07:00