litellm/tests/logging_callback_tests
ryan-crabbe 8c7051686b
perf: optimize get_standard_logging_metadata with set intersection (#19685)
* perf: Optimize get_standard_logging_metadata with set intersection

- Cache StandardLoggingMetadata.__annotations__.keys() as module-level frozenset
- Use set intersection to iterate only keys present in both metadata and supported keys
- Single lookup for user_api_key instead of 3 separate .get() calls

Results:
- get_standard_logging_metadata: 1.55s → 1.41s (9.2% faster)

* test: add unit tests for get_standard_logging_metadata non-string user_api_key handling
2026-02-07 09:35:03 -08:00
..
gcs_pub_sub_body fix: add agent_id field to GCS PubSub spend_logs_payload.json test expectation (#17938) 2025-12-13 13:35:20 -08:00
langfuse_expected_request_body fix: test_langfuse_logging_completion_with_bedrock_llm_response 2026-01-02 15:55:02 +09:00
base_test.py Litellm dev 11 11 2024 (#6693) 2024-11-12 00:16:35 +05:30
conftest.py [Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905) 2025-08-23 13:13:23 -07:00
create_mock_standard_logging_payload.py (fixes) datadog logging - handle 1MB max log size on DD (#6996) 2024-12-02 23:01:42 -08:00
gettysburg.wav (Testing) - Add e2e testing for langfuse logging with tags (#7922) 2025-01-22 09:09:25 -08:00
log.txt test: update test 2025-04-10 14:04:57 -07:00
test_alerting.py test: update langfuse trace_id tests to use litellm_trace_id 2026-01-22 06:19:43 +09:00
test_amazing_s3_logs.py fix tests 2025-10-25 10:19:24 -07:00
test_assemble_streaming_responses.py test(test_assemble_streaming_responses.py): update test to use correct type 2025-03-17 18:17:01 -07:00
test_azure_blob_storage.py (feat) Add Azure Blob Storage Logging Integration (#7265) 2024-12-16 22:18:22 -08:00
test_bedrock_knowledgebase_hook.py [Fix] - Bedrock Knowledge Bases - add support for filtering kb queries (#16543) 2025-11-12 12:38:50 -08:00
test_built_in_tools_cost_tracking.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
test_custom_callback_router.py fix tests 2025-10-25 10:19:24 -07:00
test_datadog.py feat: datadog log trace linking 2025-12-22 06:53:44 +09:00
test_datadog_llm_obs.py [Feat] Allow redacting message / response content for specific logging integrations - DD LLM Observability (#13158) 2025-07-31 16:44:16 -07:00
test_dynamic_otel_keys.py Litellm fix langfuse otel trace (#20382) 2026-02-03 22:40:19 -08:00
test_gcs_pub_sub.py fix metadata.cost_breakdown 2026-01-07 14:17:08 +05:30
test_generic_api_callback.py Add log_format parameter to GenericAPILogger (#18587) 2026-01-02 23:28:30 +05:30
test_humanloop_unit_tests.py HumanLoop integration for Prompt Management (#7479) 2024-12-30 22:26:03 -08:00
test_langfuse_e2e_test.py fix LF tests 2025-10-04 10:39:17 -07:00
test_langfuse_unit_tests.py feat(langfuse): Add support for custom masking function (#17826) 2025-12-11 15:36:54 -08:00
test_langsmith_unit_test.py Fix all 130126 tests 2026-01-14 17:47:03 +05:30
test_log_db_redis_services.py LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037) 2024-12-05 00:02:31 -08:00
test_logging_redaction_e2e_test.py test_redaction_responses_api 2025-11-08 13:43:22 -08:00
test_moderations_api_logging.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
test_opentelemetry_unit_tests.py Use already configured opentelemetry providers 2026-01-01 19:06:55 -08:00
test_otel_logging.py added tests 2026-01-21 14:41:35 -05:00
test_pagerduty_alerting.py [Refactor] Make Pagerduty a free feature (#10857) 2025-05-15 10:12:06 -07:00
test_posthog.py fix: Add atexit handlers to flush callbacks for async completions (#16487) 2025-11-11 19:12:53 -08:00
test_spend_logs.py Fix CI: Revert security scan changes and add GitGuardian ignore rules (#18358) 2025-12-22 17:03:53 -08:00
test_sqs_logger.py Add Langfuse OTEL and SQS to health check (#16514) 2025-11-12 18:25:30 -08:00
test_standard_logging_payload.py perf: optimize get_standard_logging_metadata with set intersection (#19685) 2026-02-07 09:35:03 -08:00
test_token_counting.py test_stream_token_counting_anthropic_with_include_usage 2025-10-31 20:24:58 -07:00
test_unit_test_litellm_logging.py (performance improvement - litellm sdk + proxy) - ensure litellm does not create unnecessary threads when running async functions (#7680) 2025-01-10 17:57:22 -08:00
test_unit_tests_init_callbacks.py test_init_custom_logger_compatible_class_as_callback 2025-12-06 16:21:50 -08:00
test_view_request_resp_logs.py Fix CI: Revert security scan changes and add GitGuardian ignore rules (#18358) 2025-12-22 17:03:53 -08:00