diff --git a/docs/my-website/docs/simple_proxy.md b/docs/my-website/docs/simple_proxy.md index c7212f7dd32..561a4030648 100644 --- a/docs/my-website/docs/simple_proxy.md +++ b/docs/my-website/docs/simple_proxy.md @@ -173,28 +173,10 @@ On a successfull deploy https://dashboard.render.com/ should display the followi ## Deploy on AWS Apprunner 1. Fork LiteLLM https://github.com/BerriAI/litellm 2. Navigate to to App Runner on AWS Console: https://console.aws.amazon.com/apprunner/home#/services -3. Click "Create Service" -4. Set Source and deployment - - Select Repository type as "Source code repository" - - Select GitHub as Provider - - - Select your litellm fork as "Repository" - - Set litellm_server as Source directory - -5. Configure build - - Set "Runtime" to Python3 - - Set "Build command" to `pip install -r requirements.txt` - - Set "Start command" to uvicorn main:app --host 0.0.0.0 --port 8080 - -6. Configure service - - Optional - Set LLM API Keys, example `OPENAI_API_KEY`, `ANTHROPIC_API_KEY` - - If you want to pass LLM API keys as params to `/chat/completions` then this is not required - -7. Review and Create - - Click Deploy - - On successfull deploy you should see your litellm server endpoint - -8. Testing your endpoint + + + +3. Testing your endpoint Assuming `OPENAI_API_KEY` is set in the environment variables ```shell curl https://b2w6emmkzp.us-east-1.awsapprunner.com /v1/chat/completions \ @@ -206,6 +188,7 @@ On a successfull deploy https://dashboard.render.com/ should display the followi }' ``` + ## Advanced ### Caching - Completion() and Embedding() Responses diff --git a/docs/my-website/img/aws4.png b/docs/my-website/img/aws4.png deleted file mode 100644 index afd16c6e953..00000000000 Binary files a/docs/my-website/img/aws4.png and /dev/null differ diff --git a/docs/my-website/img/aws_0.png b/docs/my-website/img/aws_0.png deleted file mode 100644 index 80219908a92..00000000000 Binary files a/docs/my-website/img/aws_0.png and /dev/null differ diff --git a/docs/my-website/img/aws_1.png b/docs/my-website/img/aws_1.png deleted file mode 100644 index ad12137f1c4..00000000000 Binary files a/docs/my-website/img/aws_1.png and /dev/null differ diff --git a/docs/my-website/img/aws_2.png b/docs/my-website/img/aws_2.png deleted file mode 100644 index 3ff7d100c9f..00000000000 Binary files a/docs/my-website/img/aws_2.png and /dev/null differ diff --git a/docs/my-website/img/aws_3.png b/docs/my-website/img/aws_3.png deleted file mode 100644 index 380229c7331..00000000000 Binary files a/docs/my-website/img/aws_3.png and /dev/null differ diff --git a/docs/my-website/img/aws_4.png b/docs/my-website/img/aws_4.png deleted file mode 100644 index a2fd03a70cd..00000000000 Binary files a/docs/my-website/img/aws_4.png and /dev/null differ diff --git a/docs/my-website/img/aws_5.png b/docs/my-website/img/aws_5.png deleted file mode 100644 index 5be5125905d..00000000000 Binary files a/docs/my-website/img/aws_5.png and /dev/null differ