mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-14 23:21:35 +00:00
* feat(terraform): Prometheus metrics sidecar for the GCP Cloud Run gateway gateway_metrics_port adds a metrics container running litellm.proxy.prometheus_metrics_server next to the gateway, sharing the PROMETHEUS_MULTIPROC_DIR over an in-memory volume, plus a Managed Service for Prometheus collector sidecar that scrapes it over localhost and writes to Cloud Monitoring. The gateway stays on port 4000 and the load balancer routing is unchanged. Resolves LIT-7502 Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(terraform): reject fractional and collector health ports for gateway_metrics_port Greptile review on #40614: 4000.5 fails integer port parsing and 13133 collides with the gmp sidecar liveness listener. Also stop claiming the load balancer's own /metrics goes away Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> --------- Co-authored-by: yassin <yassin@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| litellm | ||
| provider | ||