scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-12 23:01:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 89

Update litellm/proxy/common_request_processing.py

Browse source 
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
This commit is contained in:
harish-berri 2026-05-04 17:40:16 -07:00 • committed by GitHub
parent 9fc9e433f2
commit d2c0585f7c
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
litellm/proxy/common_request_processing.py
View file

@ -1235,15 +1235,15 @@ class ProxyBaseLLMRequestProcessing:
# upstream connection is established; the ASGI transport layer handles
# cancellation of the upstream when the client disconnects mid-stream.
responses = await llm_responses
disconnect_task.cancel()
except asyncio.CancelledError:
disconnect_task.cancel()
if disconnect_event.is_set():
raise HTTPException(
status_code=499,
detail="Client disconnected the request",
)
raise
finally:
disconnect_task.cancel()
response = responses[1]