scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-12 23:01:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 87

fix: change chunk_size for aiter_bytes

Browse source 
1KB is too small for audio and is lowering the RPS when testing with medium to large files
This commit is contained in:
AlexsanderHamir 2025-11-15 17:02:15 -08:00
parent d01efcb308
commit 44f2013495
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
litellm/proxy/proxy_server.py
View file

@ -5305,7 +5305,7 @@ async def audio_speech(
# Printing each chunk size
async def generate(_response: HttpxBinaryResponseContent):
_generator = await _response.aiter_bytes(chunk_size=1024)
_generator = await _response.aiter_bytes(chunk_size=4096)
async for chunk in _generator:
yield chunk