From fe6ff7cf1091fb5e626c14394aed4ba55921773a Mon Sep 17 00:00:00 2001 From: ishaan-jaff Date: Thu, 30 Nov 2023 10:46:48 -0800 Subject: [PATCH] (docs) proxy + librechat --- docs/my-website/docs/simple_proxy.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/docs/my-website/docs/simple_proxy.md b/docs/my-website/docs/simple_proxy.md index f3ee09431a9..70f669835e4 100644 --- a/docs/my-website/docs/simple_proxy.md +++ b/docs/my-website/docs/simple_proxy.md @@ -361,6 +361,13 @@ print(result) +### Start the LiteLLM proxy +```shell +litellm --model gpt-3.5-turbo + +#INFO: Proxy running on http://0.0.0.0:8000 +``` + #### 1. Clone the repo ```shell @@ -369,6 +376,7 @@ git clone https://github.com/danny-avila/LibreChat.git #### 2. Modify Librechat's `docker-compose.yml` +LiteLLM Proxy is running on port `8000`, set `8000` as the proxy below ```yaml OPENAI_REVERSE_PROXY=http://host.docker.internal:8000/v1/chat/completions ```