diff --git a/docs/my-website/docs/proxy/call_hooks.md b/docs/my-website/docs/proxy/call_hooks.md index 63d215764cf..b00f4e30179 100644 --- a/docs/my-website/docs/proxy/call_hooks.md +++ b/docs/my-website/docs/proxy/call_hooks.md @@ -78,7 +78,7 @@ curl --location 'http://0.0.0.0:8000/chat/completions' \ ``` -## *NEW* async_moderation_hook +## [BETA] *NEW* async_moderation_hook Run a moderation check in parallel to the actual LLM API call. @@ -89,6 +89,12 @@ In your Custom Handler add a new `async_moderation_hook` function - If your `async_moderation_hook` raises an Exception, we will return that to the user. +:::info + +We might need to update the function schema in the future, to support multiple endpoints (e.g. accept a call_type). Please keep that in mind, while trying this feature + +::: + See a complete example with our [Llama Guard content moderation hook](https://github.com/BerriAI/litellm/blob/main/enterprise/hooks/llama_guard.py) ```python