From 038433f0ad237098963c29cb6919414723dcc2ff Mon Sep 17 00:00:00 2001 From: ishaan-jaff Date: Sat, 2 Dec 2023 18:58:24 -0800 Subject: [PATCH] (docs) litellm --- docs/my-website/docs/proxy/quick_start.md | 12 ++++++++++++ 1 file changed, 12 insertions(+) diff --git a/docs/my-website/docs/proxy/quick_start.md b/docs/my-website/docs/proxy/quick_start.md index 977d1a2fbc4..265b02bcc6e 100644 --- a/docs/my-website/docs/proxy/quick_start.md +++ b/docs/my-website/docs/proxy/quick_start.md @@ -20,6 +20,12 @@ View all the supported args for the Proxy CLI [here](https://docs.litellm.ai/doc $ pip install litellm[proxy] ``` +If this fails try running + +```shell +$ pip install 'litellm[proxy]' +``` + ## Quick Start - LiteLLM Proxy CLI Run the following command to start the litellm proxy @@ -128,6 +134,12 @@ Here's how you can run the docker image and pass your config to `litellm` docker run ghcr.io/berriai/litellm:main-v1.10.0 --config your_config.yaml ``` +Here's how you can run the docker image and pass your host, port to `litellm` +Start litellm on port 8002 +```shell +docker run ghcr.io/berriai/litellm:main-v1.10.0 --port 8002 --num_workers 8 +``` + ### Server Endpoints - POST `/chat/completions` - chat completions endpoint to call 100+ LLMs - POST `/completions` - completions endpoint