scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-11 22:51:28 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 124

Merge pull request #15468 from mubashir1osmani/litellm_add_docs

Browse source 
docs: add ecs deployment guide
This commit is contained in:
Krish Dholakia 2025-10-12 22:10:00 -07:00 • committed by GitHub
commit b7b16d69bc
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 24 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

24
docs/my-website/docs/proxy/deploy.md
View file

@ -788,6 +788,30 @@ docker run --name litellm-proxy \
## Platform-specific Guide
<Tabs>
<TabItem value="AWS ECS" label="AWS ECS - Elastic Container Service>
### Terraform-based ECS Deployment
LiteLLM maintains a dedicated Terraform tutorial for deploying the proxy on ECS. Follow the step-by-step guide in the [litellm-ecs-deployment repository](https://github.com/BerriAI/litellm-ecs-deployment) to provision the required ECS services, task definitions, and supporting AWS resources.
1. Clone the tutorial repository to review the Terraform modules and variables.
```bash
git clone https://github.com/BerriAI/litellm-ecs-deployment.git
cd litellm-ecs-deployment
```
2. Initialize and validate the Terraform project before applying it to your chosen workspace/account.
```bash
terraform init
terraform plan
terraform apply
```
3. Once `terraform apply` completes, do `./build.sh` to push the repository on ECR and update the ECS cluster. Use that endpoint (port `4000` by default) for API requests to your LiteLLM proxy.
</TabItem>
<TabItem value="AWS EKS" label="AWS EKS - Kubernetes">
### Kubernetes (AWS EKS)