(docs) failing rules

This commit is contained in:
ishaan-jaff 2024-01-15 21:07:16 -08:00
parent 969b55f738
commit ab7531b6c1

View file

@ -42,4 +42,20 @@ curl --location 'http://0.0.0.0:8000/v1/chat/completions' \
```
---
This will now check if a response is > len 5, and if it fails, it'll retry a call 3 times before failing.
This will now check if a response is > len 5, and if it fails, it'll retry a call 3 times before failing.
### Response that fail the rule
This is the response from LiteLLM Proxy on failing a rule
```json
{
"error":
{
"message":"This violates LiteLLM Proxy Rules. Response too short",
"type":null,
"param":null,
"code":500
}
}
```