From 0566f359997be10866deb82cd0b7eec377a7d7d1 Mon Sep 17 00:00:00 2001 From: Ishaan Jaff Date: Wed, 12 Jun 2024 17:16:48 -0700 Subject: [PATCH] docs - let users know clarifai streaming --- docs/my-website/docs/providers/clarifai.md | 12 ++++++++---- 1 file changed, 8 insertions(+), 4 deletions(-) diff --git a/docs/my-website/docs/providers/clarifai.md b/docs/my-website/docs/providers/clarifai.md index 085ab8ed9eb..cb498650385 100644 --- a/docs/my-website/docs/providers/clarifai.md +++ b/docs/my-website/docs/providers/clarifai.md @@ -1,10 +1,13 @@ # Clarifai Anthropic, OpenAI, Mistral, Llama and Gemini LLMs are Supported on Clarifai. +:::warning + +Streaming is not yet supported on using clarifai and litellm. Tracking support here: https://github.com/BerriAI/litellm/issues/4162 + +::: + ## Pre-Requisites - -`pip install clarifai` - `pip install litellm` ## Required Environment Variables @@ -12,6 +15,7 @@ To obtain your Clarifai Personal access token follow this [link](https://docs.cl ```python os.environ["CLARIFAI_API_KEY"] = "YOUR_CLARIFAI_PAT" # CLARIFAI_PAT + ``` ## Usage @@ -68,7 +72,7 @@ Example Usage - Note: liteLLM supports all models deployed on Clarifai | clarifai/meta.Llama-2.codeLlama-70b-Python | `completion('clarifai/meta.Llama-2.codeLlama-70b-Python', messages)`| | clarifai/meta.Llama-2.codeLlama-70b-Instruct | `completion('clarifai/meta.Llama-2.codeLlama-70b-Instruct', messages)` | -## Mistal LLMs +## Mistral LLMs | Model Name | Function Call | |---------------------------------------------|------------------------------------------------------------------------| | clarifai/mistralai.completion.mixtral-8x22B | `completion('clarifai/mistralai.completion.mixtral-8x22B', messages)` |