litellm

mirror of https://github.com/BerriAI/litellm.git synced 2026-11-05 07:37:50 +00:00

History

Yuneng Jiang ffc7e6386b test(e2e-ui): delete the MCP servers these specs create MCP servers outlive the test that made them, the MCP page contacts every server it lists, and most of the ones these specs create point at an unreachable host. They accumulate, and each one makes navigateToPage's networkidle wait a little slower to settle. Measured on a local stack: with eleven leaked servers the whole MCP suite failed on a 30s navigation timeout, including specs that leaked nothing. Deleting the leftovers made all five pass. With per-test cleanup added, a run from a clean slate leaves zero behind and takes 20s instead of 1m24s. mcpServers.spec.ts carried a note that no teardown was needed because the runner brings up a fresh database each time. That holds for CI and is why this went unnoticed; it does not hold for a local stack that is reused.		2026-08-08 22:42:11 -07:00
..
agent_tests
audio_tests
base_sdk_tests
basic_proxy_startup_tests
batches_tests
benchmarks
code_coverage_tests
documentation_tests
e2e	test(e2e-ui): delete the MCP servers these specs create	2026-08-08 22:42:11 -07:00
enterprise	Merge pull request #36049 from BerriAI/litellm_list_batches_resolves_unified_ids	2026-08-07 17:59:09 -07:00
guardrails_tests
image_gen_tests
integration
litellm	fix(proxy): deny agent access when key and team grants resolve to nothing (#36221 )	2026-08-07 20:44:11 +00:00
litellm-proxy-extras
litellm_core_utils
litellm_utils_tests
llm_responses_api_testing
llm_translation
load_tests
local_testing
logging_callback_tests
mcp_tests
multi_instance_e2e_tests
ocr_tests
old_proxy_tests/tests
openai_endpoints_tests
otel_tests
pass_through_tests
pass_through_unit_tests	fix(proxy): re-assert the authenticated identity on passthrough requests (#36121 )	2026-08-07 00:41:29 +00:00
proxy_admin_ui_tests
proxy_behavior	feat(auto-router): track turns per complexity tier (LIT-5302) (#36209 )	2026-08-07 17:03:34 -07:00
proxy_e2e_anthropic_messages_tests
proxy_migration_tests	test(docker): gate the componentized gateway and backend images on an arbitrary-uid offline boot (#36136 )	2026-08-07 09:57:37 -07:00
proxy_security_tests
proxy_unit_tests
router_unit_tests
scim_tests
search_tests
spend_tracking_tests
store_model_in_db_tests
test_litellm	refactor(vertex_ai): drop unreachable post-path status checks in batches handler	2026-08-07 23:00:50 -07:00
unified_google_tests
vector_store_tests
windows_tests
__init__.py
_fake_openai_endpoint_server.py
_flush_vcr_cache.py
_live_test_helpers.py
_openai_record_replay_proxy.py
_vcr_conftest_common.py
_vcr_redis_persister.py
_ws_vcr.py
eval_swe_bench.py
fake_openai_endpoint.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
pyrightconfig.json
README.MD
test_anthropic_compaction_usage.py
test_budget_management.py
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_default_encoding_non_root.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py
test_gpt5_azure_temperature_support.py
test_health.py
test_keys.py
test_litellm_proxy_responses_config.py
test_logging.conf
test_models.py
test_new_vector_store_endpoints.py
test_openai_endpoints.py
test_organizations.py
test_otel_thread_leak.py
test_passthrough_endpoints.py
test_presidio_latency.py
test_proxy_server_non_root.py
test_ratelimit.py
test_resource_cleanup.py
test_service_logger_otel.py
test_spend_logs.py
test_team.py
test_team_logging.py
test_team_members.py
test_users.py

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.