litellm/tests/logging_callback_tests
Ishaan Jaff b9132968b2
[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905)
* [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895)

* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix

* create LoggingWorker

* add GLOBAL_LOGGING_WORKER for async task handling

* fix logging tests

* add conftest

* fix conftest

* test fix location of encode bedrock runtime modelid arn

* fix conftest.py

* tuning LoggingWorker

* conftest.py

* fix conftest batches/

* test_async_chat_azure

* event_loop

* test_bedrock_streaming_passthrough_test2

* fix GLOBAL_LOGGING_WORKER

* logging worker

* add flush for global logging worker

* Revert "fix GLOBAL_LOGGING_WORKER"

This reverts commit d254f508f4.

* fix conftest clear_queue

* fix conftest clear_queue

* setup_and_teardown for llm translation

* docs AWS_REGION

* test_async_chat_azure

* change test DIR

* run ci/cd again

* use 1 job for litellm_router_unit_testing

* fix space

* fix litellm_router_unit_testing

* test_aaarouter_dynamic_cooldown_message_retry_time

* litellm_router_unit_testing

* conftest.py clearing qu

* fixes litellm_router_unit_testing

* fixes clear_queue

* fix router_unit_tests

* remove conftest

* add back conftest for router

* fix event loop test

* test fix

* fixes for LoggingWorker

* ruff fix
2025-08-23 13:13:23 -07:00
..
gcs_pub_sub_body MCP - usage tracking (#12397) 2025-07-08 22:08:16 -07:00
langfuse_expected_request_body fix(utils.py): support non default params for audio transcription (#11212) 2025-05-28 22:24:02 -07:00
base_test.py Litellm dev 11 11 2024 (#6693) 2024-11-12 00:16:35 +05:30
conftest.py [Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905) 2025-08-23 13:13:23 -07:00
create_mock_standard_logging_payload.py (fixes) datadog logging - handle 1MB max log size on DD (#6996) 2024-12-02 23:01:42 -08:00
gettysburg.wav (Testing) - Add e2e testing for langfuse logging with tags (#7922) 2025-01-22 09:09:25 -08:00
log.txt test: update test 2025-04-10 14:04:57 -07:00
test_alerting.py [Feat] Performance - Don't create 1 task for every hanging request alert (#11385) 2025-06-03 21:12:54 -07:00
test_amazing_s3_logs.py [Feat] Responses API Session Handling - Multi media support (#13347) 2025-08-07 10:59:53 -07:00
test_assemble_streaming_responses.py test(test_assemble_streaming_responses.py): update test to use correct type 2025-03-17 18:17:01 -07:00
test_azure_blob_storage.py (feat) Add Azure Blob Storage Logging Integration (#7265) 2024-12-16 22:18:22 -08:00
test_bedrock_knowledgebase_hook.py [Refactor] Vector Stores - Use class VectorStorePreCallHook for all Vector Store Integrations (#12715) 2025-07-17 16:31:58 -07:00
test_built_in_tools_cost_tracking.py test_openai_responses_api_web_search_cost_tracking 2025-05-03 20:22:42 -07:00
test_custom_callback_router.py [Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905) 2025-08-23 13:13:23 -07:00
test_datadog.py Ensure message redaction works for responses API logging (#12291) 2025-07-04 15:11:20 -07:00
test_datadog_llm_obs.py [Feat] Allow redacting message / response content for specific logging integrations - DD LLM Observability (#13158) 2025-07-31 16:44:16 -07:00
test_gcs_pub_sub.py [Feat] Responses API Session Handling - Multi media support (#13347) 2025-08-07 10:59:53 -07:00
test_generic_api_callback.py fix: pass application/json for GenericAPILogger (#10772) 2025-05-12 14:15:33 -07:00
test_humanloop_unit_tests.py HumanLoop integration for Prompt Management (#7479) 2024-12-30 22:26:03 -08:00
test_langfuse_e2e_test.py Litellm dev 05 26 2025 p1 (#11165) 2025-05-26 22:00:48 -07:00
test_langfuse_unit_tests.py test: fixes 2025-05-31 12:42:56 -07:00
test_langsmith_unit_test.py (Bug fix) - don't log messages in model_parameters in StandardLoggingPayload (#8932) 2025-03-01 13:39:45 -08:00
test_log_db_redis_services.py LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037) 2024-12-05 00:02:31 -08:00
test_logging_redaction_e2e_test.py add fix for redaction (#13005) 2025-07-25 17:48:48 -07:00
test_moderations_api_logging.py [Bug Fix] Fix model_group tracked for /v1/messages and /moderations (#11933) 2025-06-20 14:51:50 -07:00
test_opentelemetry_unit_tests.py Fix otel - follow genai semantic conventions + support 'instructions' param for tts (#10608) 2025-05-06 21:57:01 -07:00
test_otel_logging.py [Feat] Responses API Session Handling - Multi media support (#13347) 2025-08-07 10:59:53 -07:00
test_pagerduty_alerting.py [Refactor] Make Pagerduty a free feature (#10857) 2025-05-15 10:12:06 -07:00
test_spend_logs.py [Feat] Responses API - Add session management support for non-openai models (#10321) 2025-04-25 23:24:24 -07:00
test_sqs_logger.py [Feat] Add new AWS SQS Logging Integration (#12176) 2025-06-30 14:02:49 -07:00
test_standard_logging_payload.py [Feat] Responses API - Add session management support for non-openai models (#10321) 2025-04-25 23:24:24 -07:00
test_token_counting.py Revert "test_stream_token_counting_anthropic_with_include_usage" 2025-08-16 13:07:00 -07:00
test_unit_test_litellm_logging.py (performance improvement - litellm sdk + proxy) - ensure litellm does not create unnecessary threads when running async functions (#7680) 2025-01-10 17:57:22 -08:00
test_unit_tests_init_callbacks.py feat(integrations): allow setting of braintrust callback base url (#13368) 2025-08-07 08:40:11 -07:00
test_view_request_resp_logs.py (Feat) - Allow viewing Request/Response Logs stored in GCS Bucket (#8449) 2025-02-10 20:38:55 -08:00