scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-07 08:26:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 89

Merge pull request #3653 from BerriAI/litellm_fix_text_completions

Browse source 
[Fix] - Alerting on `/completions` -  don't raise hanging request alert for /completions
This commit is contained in:
Ishaan Jaff 2024-05-15 11:28:55 -07:00 • committed by GitHub
commit 74f093bb4b
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
litellm/proxy/proxy_server.py
View file

@ -4015,6 +4015,9 @@ async def completion(
cache_key = hidden_params.get("cache_key", None) or ""
api_base = hidden_params.get("api_base", None) or ""
### ALERTING ###
data["litellm_status"] = "success" # used for alerting
verbose_proxy_logger.debug("final response: %s", response)
if (
"stream" in data and data["stream"] == True