scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-08 22:21:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 78

docs prometheus end user tracking

Browse source
This commit is contained in:
Ishaan Jaff 2025-05-31 14:21:37 -07:00
parent 170af8f2c8
commit cdfb6b8c37
1 changed files with 13 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

13
docs/my-website/docs/proxy/prometheus.md
View file

@ -180,6 +180,19 @@ Use this for LLM API Error monitoring and tracking remaining rate limits and tok
| `litellm_llm_api_latency_metric` | Latency (seconds) for just the LLM API call - tracked for labels "model", "hashed_api_key", "api_key_alias", "team", "team_alias", "requested_model", "end_user", "user" |
| `litellm_llm_api_time_to_first_token_metric` | Time to first token for LLM API call - tracked for labels `model`, `hashed_api_key`, `api_key_alias`, `team`, `team_alias` [Note: only emitted for streaming requests] |
## Tracking `end_user` on Prometheus
By default LiteLLM does not track `end_user` on Prometheus. This is done to reduce the cardinality of the metrics from LiteLLM Proxy.
If you want to track `end_user` on Prometheus, you can do the following:
```yaml showLineNumbers title="config.yaml"
litellm_settings:
callbacks: ["prometheus"]
enable_end_user_cost_tracking_prometheus_only: true
```
## [BETA] Custom Metrics
Track custom metrics on prometheus on all events mentioned above.