mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-06 02:48:13 +00:00
9e18526887
* feat(deploy): expose SSE keepalive, pre-call checks and a metrics sidecar in Helm and Terraform Typed reliability values on both Helm charts and the AWS/GCP Terraform modules, a dedicated ClusterIP Service for the separate Prometheus port, a /health route on the metrics server and dead-worker pruning so the aggregate does not keep stale multiprocess samples. Resolves LIT-7142 Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * refactor(deploy): drop reliability config from Helm and Terraform, keep only the metrics sidecar Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(proxy): cover startup pruning of dead workers' live gauges and unsignalable pids Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> --------- Co-authored-by: yassin <yassin@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| tests | ||
| _helpers.tpl | ||
| configmap-litellm.yaml | ||
| deployment.yaml | ||
| extra-resources.yaml | ||
| hpa.yaml | ||
| ingress.yaml | ||
| keda.yaml | ||
| migrations-job.yaml | ||
| NOTES.txt | ||
| poddisruptionbudget.yaml | ||
| secret-dbcredentials.yaml | ||
| secret-masterkey.yaml | ||
| service-metrics.yaml | ||
| service.yaml | ||
| serviceaccount.yaml | ||
| servicemonitor.yaml | ||