litellm/tests/mcp_tests
Ishaan Jaff b9132968b2
[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905)
* [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895)

* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix

* create LoggingWorker

* add GLOBAL_LOGGING_WORKER for async task handling

* fix logging tests

* add conftest

* fix conftest

* test fix location of encode bedrock runtime modelid arn

* fix conftest.py

* tuning LoggingWorker

* conftest.py

* fix conftest batches/

* test_async_chat_azure

* event_loop

* test_bedrock_streaming_passthrough_test2

* fix GLOBAL_LOGGING_WORKER

* logging worker

* add flush for global logging worker

* Revert "fix GLOBAL_LOGGING_WORKER"

This reverts commit d254f508f4.

* fix conftest clear_queue

* fix conftest clear_queue

* setup_and_teardown for llm translation

* docs AWS_REGION

* test_async_chat_azure

* change test DIR

* run ci/cd again

* use 1 job for litellm_router_unit_testing

* fix space

* fix litellm_router_unit_testing

* test_aaarouter_dynamic_cooldown_message_retry_time

* litellm_router_unit_testing

* conftest.py clearing qu

* fixes litellm_router_unit_testing

* fixes clear_queue

* fix router_unit_tests

* remove conftest

* add back conftest for router

* fix event loop test

* test fix

* fixes for LoggingWorker

* ruff fix
2025-08-23 13:13:23 -07:00
..
conftest.py [Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905) 2025-08-23 13:13:23 -07:00
mcp_server.py simple MCP interface 2025-03-21 10:11:06 -07:00
test_aresponses_api_with_mcp.py [Feat] MCP Gateway - allow using MCPs with all LLM APIs when using /responses with LiteLLM (#12546) 2025-07-15 14:06:31 -07:00
test_mcp_client_unit.py Revert "Revert "[MCP Gateway] Add protocol headers (#13062)"" 2025-07-29 18:14:31 -07:00
test_mcp_guardrails.py [MCP Gateway] Litellm mcp pre and during guardrails (#13188) 2025-08-01 20:02:25 -07:00
test_mcp_hooks.py [MCP gateway] add pre and during call hooks init (#13067) 2025-07-29 11:06:58 -07:00
test_mcp_litellm_client.py [MCP Gateway] Litellm mcp client list fail (#13114) 2025-07-30 15:23:19 -07:00
test_mcp_logging.py [MCP Gateway] - Allow using custom post call MCP hook for cost tracking (#12469) 2025-07-09 18:41:08 -07:00
test_mcp_server.py [MCP Gateway] LiteLLM Fix MCP gateway key auth (#13630) 2025-08-14 16:32:18 -07:00