litellm/tests/logging_callback_tests
Krish Dholakia 9d82ff4793
Litellm dev 12 26 2024 p3 (#7434)
* build(model_prices_and_context_window.json): update groq models to specify 'supports_vision' parameter

Closes https://github.com/BerriAI/litellm/issues/7433

* docs(groq.md): add groq vision example to docs

Closes https://github.com/BerriAI/litellm/issues/7433

* fix(prometheus.py): refactor self.litellm_proxy_failed_requests_metric to use label factory

* feat(prometheus.py): new 'litellm_proxy_failed_requests_by_tag_metric'

allows tracking failed requests by tag on proxy

* fix(prometheus.py): fix exception logging

* feat(prometheus.py): add new 'litellm_request_total_latency_by_tag_metric'

enables tracking latency by use-case

* feat(prometheus.py): add new llm api latency by tag metric

* feat(prometheus.py): new litellm_deployment_latency_per_output_token_by_tag metric

allows tracking deployment latency by tag

* fix(prometheus.py): refactor 'litellm_requests_metric' to use enum values + label factory

* feat(prometheus.py): new litellm_proxy_total_requests_by_tag metric

allows tracking total requests by tag

* feat(prometheus.py): new metric litellm_deployment_successful_fallbacks_by_tag

allows tracking deployment fallbacks by tag

* fix(prometheus.py): new 'litellm_deployment_failed_fallbacks_by_tag' metric

allows tracking failed fallbacks on deployment by custom tag

* test: fix test

* test: rename test to run earlier

* test: skip flaky test
2024-12-26 21:21:16 -08:00
..
base_test.py Litellm dev 11 11 2024 (#6693) 2024-11-12 00:16:35 +05:30
conftest.py (refactor) use helper function _assemble_complete_response_from_streaming_chunks to assemble complete responses in caching and logging callbacks (#6220) 2024-10-15 12:45:12 +05:30
create_mock_standard_logging_payload.py (fixes) datadog logging - handle 1MB max log size on DD (#6996) 2024-12-02 23:01:42 -08:00
test_assemble_streaming_responses.py [Bug Fix]: ImportError: cannot import name 'T' from 're' (#7314) 2024-12-19 13:09:30 -08:00
test_azure_blob_storage.py (feat) Add Azure Blob Storage Logging Integration (#7265) 2024-12-16 22:18:22 -08:00
test_custom_guardrail.py (feat) Support Dynamic Params for guardrails (#7415) 2024-12-25 16:07:29 -08:00
test_datadog.py dd logger fix - handle objects that can't be JSON dumped (#7393) 2024-12-23 18:21:49 -08:00
test_datadog_llm_obs.py LiteLLM Minor Fixes & Improvements (11/04/2024) (#6572) 2024-11-06 17:53:46 +05:30
test_langfuse_unit_tests.py LiteLLM Minor Fixes & Improvements (11/12/2024) (#6705) 2024-11-12 22:50:51 +05:30
test_langsmith_unit_test.py Litellm dev 11 30 2024 (#6974) 2024-12-02 21:03:33 -08:00
test_log_db_redis_services.py LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037) 2024-12-05 00:02:31 -08:00
test_logging_redaction_e2e_test.py (feat) Allow enabling logging message / response for specific virtual keys (#7071) 2024-12-06 21:25:36 -08:00
test_opentelemetry_unit_tests.py Litellm dev 11 11 2024 (#6693) 2024-11-12 00:16:35 +05:30
test_otel_logging.py Litellm dev 12 20 2024 p3 (#7339) 2024-12-20 21:13:32 -08:00
test_prometheus_unit_tests.py Litellm dev 12 26 2024 p3 (#7434) 2024-12-26 21:21:16 -08:00
test_spend_logs.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
test_standard_logging_payload.py [Bug Fix]: ImportError: cannot import name 'T' from 're' (#7314) 2024-12-19 13:09:30 -08:00
test_unit_tests_init_callbacks.py (fix) initializing OTEL Logging on LiteLLM Proxy - ensure OTEL logger is initialized only once (#7435) 2024-12-26 21:17:19 -08:00