scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-11-12 08:42:18 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 207

test(integration): backport the team delete warmup fix from #47135 to rc/1.108.0

Browse source 
Takes only the max_workers change in test_team_delete_large_membership.py from 7e8be61fa0. The 16-thread key warmup slowed the /team/delete that follows it to 5.4-11.6s locally against the client's 15s timeout, and 2 threads brings it to 4.1-5.4s
This commit is contained in:
Yuneng Jiang 2026-10-31 18:02:12 -07:00
parent f86f570aca
commit 13218620ed
No known key found for this signature in database
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
tests/integration/management/test_team_delete_large_membership.py
View file

@ -727,7 +727,7 @@ def _models_status(proxy: Gateway, key: str) -> int:
def _statuses(proxy: Gateway, keys: Sequence[str]) -> dict[int, int]:
with ThreadPoolExecutor(max_workers=16) as pool:
with ThreadPoolExecutor(max_workers=2) as pool:
statuses: Final = tuple(pool.map(lambda key: _models_status(proxy, key), keys))
return {status: statuses.count(status) for status in frozenset(statuses)}