mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-10 22:41:41 +00:00
9e18526887
* feat(deploy): expose SSE keepalive, pre-call checks and a metrics sidecar in Helm and Terraform Typed reliability values on both Helm charts and the AWS/GCP Terraform modules, a dedicated ClusterIP Service for the separate Prometheus port, a /health route on the metrics server and dead-worker pruning so the aggregate does not keep stale multiprocess samples. Resolves LIT-7142 Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * refactor(deploy): drop reliability config from Helm and Terraform, keep only the metrics sidecar Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(proxy): cover startup pruning of dead workers' live gauges and unsignalable pids Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> --------- Co-authored-by: yassin <yassin@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| billing_metrics_tests.yaml | ||
| bundled_db_images_tests.yaml | ||
| coordination_redis_tests.yaml | ||
| deployment_command_args_labels_tests.yaml | ||
| deployment_tests.yaml | ||
| hpa_tests.yaml | ||
| ingress_tests.yaml | ||
| masterkey-secret_tests.yaml | ||
| metrics_server_tests.yaml | ||
| migrations-job_tests.yaml | ||
| pdb_tests.yaml | ||
| service_tests.yaml | ||