scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-06 08:16:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 78

(docs) proxy - we now use gunicorn default

Browse source
This commit is contained in:
ishaan-jaff 2024-01-10 22:09:25 +05:30
parent 59669b4c2a
commit 03a0e04b0d
1 changed files with 0 additions and 8 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

8
docs/my-website/docs/proxy/quick_start.md
View file

@ -374,14 +374,6 @@ litellm --config your_config.yaml
- GET `/models` - available models on server
- POST `/key/generate` - generate a key to access the proxy
## Gunicorn + Proxy
Command:
```python
cmd = f"gunicorn litellm.proxy.proxy_server:app --workers {num_workers} --worker-class uvicorn.workers.UvicornWorker --bind {host}:{port}"
```
[**Code**](https://github.com/BerriAI/litellm/blob/077f6b1298101079b72396bdf04f8ca0cf737720/litellm/tests/test_proxy_gunicorn.py#L4)
## Quick Start Docker Image: Github Container Registry
### Pull the litellm ghcr docker image