scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-14 23:21:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 102

(docs) litellm

Browse source
This commit is contained in:
ishaan-jaff 2023-12-02 18:58:24 -08:00
parent a67240e67f
commit 038433f0ad
1 changed files with 12 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

12
docs/my-website/docs/proxy/quick_start.md
View file

@ -20,6 +20,12 @@ View all the supported args for the Proxy CLI [here](https://docs.litellm.ai/doc
$ pip install litellm[proxy]
```
If this fails try running
```shell
$ pip install 'litellm[proxy]'
```
## Quick Start - LiteLLM Proxy CLI
Run the following command to start the litellm proxy
@ -128,6 +134,12 @@ Here's how you can run the docker image and pass your config to `litellm`
docker run ghcr.io/berriai/litellm:main-v1.10.0 --config your_config.yaml
```
Here's how you can run the docker image and pass your host, port to `litellm`
Start litellm on port 8002
```shell
docker run ghcr.io/berriai/litellm:main-v1.10.0 --port 8002 --num_workers 8
```
### Server Endpoints
- POST `/chat/completions` - chat completions endpoint to call 100+ LLMs
- POST `/completions` - completions endpoint