Krish Dholakia
c92b6c175c
Prometheus - fix request increment + add route tracking for streaming requests ( #11731 )
...
* fix(prometheus.py): remove request increment from inside the log success event
it's only done on post-call success/failure
* fix(litellm_logging.py): add additional validation step for checking if 'stream' is true
prevent double counting on non-stream requests
* test: add unit testing to ensure stream is not incorrectly set to true
* feat(litellm_logging.py): emit request route in standard logging payload
used by prometheus streaming metrics for route
* fix: fix otel test
* fix: fix linting errors
* test: update test
* fix: fix linting error
2025-06-14 16:26:48 -07:00
Ishaan Jaff
b091c1ac4d
[Feat] Prometheus - Allow controlling exposed metrics and labels ( #11489 )
...
* feat: init prometheus_metrics_config
* feat: add prometheus_metrics_config
* test prometheus
* feat: use factor to init metrics
* fix - pretty print allowed metrics controls
* fix config
* fix - working get_labels_for_metric
* test_no_prometheus_config
* docs update prometheus
2025-06-14 13:56:40 -07:00
Krish Dholakia
7df76175b4
fix(prometheus.py): fix total token increment + add semantic tests for prometheus metrics ( #11718 )
...
fixes regression where total requests was incremented by token value
2025-06-13 16:43:00 -07:00
Walt Wells
f782cc7e4d
update GCSBucketBase to handle GSM project ID if passed ( #11409 )
2025-06-04 10:02:26 -07:00
Ishaan Jaff
a1f3a1c5dc
[Feat] Performance - Don't create 1 task for every hanging request alert ( #11385 )
...
* feat: add async_get_oldest_n_keys in memory cache
* fix: add add_request_to_hanging_request_check
* test: alerting
* feat: v2 hanging request check
* fix: HangingRequestData
* fix: AlertingHangingRequestCheck
* fix: check_for_hanging_requests
* fix: use correct metadata location for hanging requests
* fix: formatting alert
* test hanging request check
* fix: add guard flags for background tasks alerting
2025-06-03 21:12:54 -07:00
Ishaan Jaff
0590b1eb3a
[Fix] Prometheus Metrics - Do not track end_user by default + expose flag to enable tracking end_user on prometheus ( #11192 )
...
* fix: testing for disabling end user on metrics
* fix: fixes for test_prometheus_factory
* Delete litellm/model_prices_and_context_window_backup.json
* fix: issues with merge conflicts
* fix: test_get_end_user_id_for_cost_tracking_prometheus_only
* Update tests/test_litellm/integrations/test_prometheus.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-27 17:06:58 -07:00
Krish Dholakia
ef42461c1e
Litellm fix GitHub action testing ( #11163 )
...
* test: add __init__.py files
* refactor: rename test folder to avoid naming conflict
* test: update workflows
* test: update tests
* test: update imports
* test: update tests
* test: remove unused import
* ci(test-litellm.yml): add pytest retry to github workflow
* test: fix test
2025-05-26 14:41:42 -07:00
