scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-09 22:31:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 87

fix(huggingface_restapi.py): catch streaming errors

Browse source
This commit is contained in:
Krrish Dholakia 2024-02-15 20:55:21 -08:00
parent eb45df16f1
commit 0bf35b4a91
1 changed files with 6 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

8
litellm/llms/huggingface_restapi.py
View file

@ -630,8 +630,12 @@ class Huggingface(BaseLLM):
custom_llm_provider="huggingface",
logging_obj=logging_obj,
)
async for transformed_chunk in streamwrapper:
yield transformed_chunk
async def generator():
async for transformed_chunk in streamwrapper:
yield transformed_chunk
return generator()
def embedding(
self,