From a3e0ae82cae7ddc6c65ef83c621ef948219701ca Mon Sep 17 00:00:00 2001 From: Ishaan Jaff Date: Mon, 8 Jul 2024 12:11:45 -0700 Subject: [PATCH] docs - openai compatible --- docs/my-website/docs/providers/openai_compatible.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/docs/my-website/docs/providers/openai_compatible.md b/docs/my-website/docs/providers/openai_compatible.md index 33ab8fb4117..f6225d716a5 100644 --- a/docs/my-website/docs/providers/openai_compatible.md +++ b/docs/my-website/docs/providers/openai_compatible.md @@ -63,6 +63,14 @@ Here's how to call an OpenAI-Compatible Endpoint with the LiteLLM Proxy Server api_key: api-key # api key to send your model ``` + :::info + + If you see `Not Found Error` when testing make sure your `api_base` has the `/v1` postfix + + Example: `http://vllm-endpoint.xyz/v1` + + ::: + 2. Start the proxy ```bash