scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-07 08:26:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 36

docs(openai-proxy-readme): positioning stuff

Browse source
This commit is contained in:
Krrish Dholakia 2023-10-23 17:25:06 -07:00
parent c99fa955f4
commit 87c32d7a95
1 changed files with 13 additions and 12 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

25
openai-proxy/README.md
View file

@ -17,18 +17,6 @@ A simple, fast, and lightweight **OpenAI-compatible server** to call 100+ LLM AP
docker run -e PORT=8000 -p 8000:8000 ghcr.io/berriai/litellm:latest
```
### Running Locally
```shell
$ git clone https://github.com/BerriAI/litellm.git
```
```shell
$ cd ./litellm/openai-proxy
```
```shell
$ uvicorn main:app --host 0.0.0.0 --port 8000
```
## Endpoints:
- `/chat/completions` - chat completions endpoint to call 100+ LLMs
- `/models` - available models on server
@ -69,4 +57,17 @@ response = openai.ChatCompletion.create(
print(response)
```
### Running Locally
```shell
$ git clone https://github.com/BerriAI/litellm.git
```
```shell
$ cd ./litellm/openai-proxy
```
```shell
$ uvicorn main:app --host 0.0.0.0 --port 8000
```
[**See how to call Huggingface,Bedrock,TogetherAI,Anthropic, etc.**](https://docs.litellm.ai/docs/simple_proxy)