scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-07 02:59:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 103

docs(simple_proxy.md): adding bedrock tutorial

Browse source
This commit is contained in:
Krrish Dholakia 2023-11-03 12:58:39 -07:00
parent 43e69a7aa8
commit f6486b9df9
2 changed files with 15 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
docs/my-website/docs/proxy_server.md
View file

@ -5,6 +5,12 @@ import TabItem from '@theme/TabItem';
A fast, and lightweight OpenAI-compatible server to call 100+ LLM APIs.
:::info
Docs outdated. New docs 👉 [here](./simple_proxy.md)
:::
## Usage
```shell
pip install litellm

9
docs/my-website/docs/simple_proxy.md
View file

@ -41,6 +41,15 @@ This will now automatically route any requests for gpt-3.5-turbo to bigcode star
#### Other supported models:
<Tabs>
<TabItem value="bedrock" label="Bedrock">
```shell
$ export AWS_ACCESS_KEY_ID=""
$ export AWS_REGION_NAME="" # e.g. us-west-2
$ export AWS_SECRET_ACCESS_KEY=""
$ litellm --model bedrock/anthropic.claude-v2
```
</TabItem>
<TabItem value="vllm-local" label="VLLM">
Assuming you're running vllm locally