scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-08 22:21:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 78

allow async_only_mode on rotuer

Browse source
This commit is contained in:
Ishaan Jaff 2024-07-06 12:50:57 -07:00
parent 2452753e08
commit 80a31c5dab
1 changed files with 6 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
litellm/types/router.py
View file

@ -517,3 +517,9 @@ class CustomRoutingStrategyBase:
"""
pass
class RouterGeneralSettings(BaseModel):
async_only_mode: bool = Field(
default=False
) # this will only initialize async clients. Good for memory utils