scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-09 03:18:44 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 108

(docs) cleanup

Browse source
This commit is contained in:
ishaan-jaff 2023-11-09 13:20:15 -08:00
parent 376dae73f9
commit 9fd51f66d0
1 changed files with 0 additions and 26 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

26
docs/my-website/docs/proxy_server.md
View file

@ -136,32 +136,6 @@ $ litellm --model command-nightly
</Tabs>
[**Jump to Code**](https://github.com/BerriAI/litellm/blob/fef4146396d5d87006259e00095a62e3900d6bb4/litellm/proxy.py#L36)
## Docker
Here's how to use our Docker image to go to production with OpenAI Proxy Server
```shell
git clone https://github.com/BerriAI/litellm.git
```
Add your API keys / LLM configs to `template_secrets.toml`.
```shell
[keys]
OPENAI_API_KEY="sk-..."
COHERE_API_KEY="Wa-..."
```
[All Configs](https://github.com/BerriAI/litellm/blob/main/secrets_template.toml)
Run Docker image:
```shell
docker build -t litellm . && docker run -p 8000:8000 litellm
## INFO: OpenAI Proxy server running on http://0.0.0.0:8000
```
### Tutorial: Use with Multiple LLMs + LibreChat/Chatbot-UI/Auto-Gen/ChatDev/Langroid,etc.
<Tabs>
<TabItem value="multiple-LLMs" label="Multiple LLMs">