scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-09 22:31:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 133

fix #11857 (#11859)

Browse source
This commit is contained in:
Shankyg 2025-06-19 06:35:12 +09:30 • committed by GitHub
parent ae74eb833b
commit 58dce17414
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 10 additions and 10 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

20
docs/my-website/docs/proxy/prometheus.md
View file

@ -23,9 +23,9 @@ If you're using the LiteLLM CLI with `litellm --config proxy_config.yaml` then y
Add this to your proxy config.yaml
```yaml
model_list:
- model_name: gpt-3.5-turbo
- model_name: gpt-4o
litellm_params:
model: gpt-3.5-turbo
model: gpt-4o
litellm_settings:
callbacks: ["prometheus"]
```
@ -40,7 +40,7 @@ Test Request
curl --location 'http://0.0.0.0:4000/chat/completions' \
--header 'Content-Type: application/json' \
--data '{
"model": "gpt-3.5-turbo",
"model": "gpt-4o",
"messages": [
{
"role": "user",
@ -201,9 +201,9 @@ Track custom metrics on prometheus on all events mentioned above.
```yaml
model_list:
- model_name: openai/gpt-3.5-turbo
- model_name: openai/gpt-4o
litellm_params:
model: openai/gpt-3.5-turbo
model: openai/gpt-4o
api_key: os.environ/OPENAI_API_KEY
litellm_settings:
@ -218,7 +218,7 @@ curl -L -X POST 'http://0.0.0.0:4000/v1/chat/completions' \
-H 'Content-Type: application/json' \
-H 'Authorization: Bearer <LITELLM_API_KEY>' \
-d '{
"model": "openai/gpt-3.5-turbo",
"model": "openai/gpt-4o",
"messages": [
{
"role": "user",
@ -254,9 +254,9 @@ Configure which metrics to emit by specifying them in `prometheus_metrics_config
```yaml
model_list:
- model_name: gpt-3.5-turbo
- model_name: gpt-4o
litellm_params:
model: gpt-3.5-turbo
model: gpt-4o
litellm_settings:
callbacks: ["prometheus"]
@ -358,9 +358,9 @@ To monitor the health of litellm adjacent services (redis / postgres), do:
```yaml
model_list:
- model_name: gpt-3.5-turbo
- model_name: gpt-4o
litellm_params:
model: gpt-3.5-turbo
model: gpt-4o
litellm_settings:
service_callback: ["prometheus_system"]
```