From 6ff427144e792cc15a3184108eb2607b80f16018 Mon Sep 17 00:00:00 2001 From: Ishaan Jaff Date: Tue, 18 Jun 2024 10:45:09 -0700 Subject: [PATCH 1/2] docs - deep infra llama3 --- docs/my-website/docs/providers/deepinfra.md | 13 +++++++++---- docs/my-website/docs/providers/groq.md | 6 +++++- 2 files changed, 14 insertions(+), 5 deletions(-) diff --git a/docs/my-website/docs/providers/deepinfra.md b/docs/my-website/docs/providers/deepinfra.md index 3c6506308cf..1360117445f 100644 --- a/docs/my-website/docs/providers/deepinfra.md +++ b/docs/my-website/docs/providers/deepinfra.md @@ -1,6 +1,13 @@ # DeepInfra https://deepinfra.com/ +:::tip + +**We support ALL DeepInfra models, just set `model=deepinfra/` as a prefix when sending litellm requests** + +::: + + ## API Key ```python # env variable @@ -38,13 +45,11 @@ for chunk in response: ## Chat Models | Model Name | Function Call | |------------------|--------------------------------------| +| meta-llama/Meta-Llama-3-8B-Instruct | `completion(model="deepinfra/meta-llama/Meta-Llama-3-8B-Instruct", messages)` | +| meta-llama/Meta-Llama-3-70B-Instruct | `completion(model="deepinfra/meta-llama/Meta-Llama-3-70B-Instruct", messages)` | | meta-llama/Llama-2-70b-chat-hf | `completion(model="deepinfra/meta-llama/Llama-2-70b-chat-hf", messages)` | | meta-llama/Llama-2-7b-chat-hf | `completion(model="deepinfra/meta-llama/Llama-2-7b-chat-hf", messages)` | | meta-llama/Llama-2-13b-chat-hf | `completion(model="deepinfra/meta-llama/Llama-2-13b-chat-hf", messages)` | | codellama/CodeLlama-34b-Instruct-hf | `completion(model="deepinfra/codellama/CodeLlama-34b-Instruct-hf", messages)` | | mistralai/Mistral-7B-Instruct-v0.1 | `completion(model="deepinfra/mistralai/Mistral-7B-Instruct-v0.1", messages)` | | jondurbin/airoboros-l2-70b-gpt4-1.4.1 | `completion(model="deepinfra/jondurbin/airoboros-l2-70b-gpt4-1.4.1", messages)` | - - - - diff --git a/docs/my-website/docs/providers/groq.md b/docs/my-website/docs/providers/groq.md index 857aae5bd2c..74e83a8c822 100644 --- a/docs/my-website/docs/providers/groq.md +++ b/docs/my-website/docs/providers/groq.md @@ -1,7 +1,11 @@ # Groq https://groq.com/ -**We support ALL Groq models, just set `groq/` as a prefix when sending completion requests** +:::tip + +**We support ALL Groq models, just set `groq/` as a prefix when sending litellm requests** + +::: ## API Key ```python From 06e416f2b0e4680c7e7b89fdd69ab77c86b7995d Mon Sep 17 00:00:00 2001 From: Ishaan Jaff Date: Tue, 18 Jun 2024 10:46:34 -0700 Subject: [PATCH 2/2] docs - using groq models --- docs/my-website/docs/providers/groq.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/my-website/docs/providers/groq.md b/docs/my-website/docs/providers/groq.md index 74e83a8c822..70b9f00d685 100644 --- a/docs/my-website/docs/providers/groq.md +++ b/docs/my-website/docs/providers/groq.md @@ -3,7 +3,7 @@ https://groq.com/ :::tip -**We support ALL Groq models, just set `groq/` as a prefix when sending litellm requests** +**We support ALL Groq models, just set `model=groq/` as a prefix when sending litellm requests** :::