ryan-crabbe-berri 048a1500df test(e2e): move the harness self-tests out of tests/e2e (#45172) ... * test(e2e): move the harness self-tests out of tests/e2e The nightly Buildkite run copies tests/e2e into the runner image and runs bare pytest, so the 672 tests of the harness itself (fixture parsing, JUnit properties, the stack lock, the load aggregators, the Claude Code driver) counted as e2e tests on the status page even though none of them reaches a proxy. They now live in tests/e2e_harness, mirroring the tests/e2e layout, and run in the GitHub Actions lint job and the CircleCI provider_replay_harness job instead * fix(ci): point the providers replay controls at tests/e2e_harness The providers integration job still selected the four replay-control tests under tests/e2e/test_provider_edge.py, so pytest exited before they ran. The raw-HTTP check's file walk also drops to one loop per comprehension * style(tests): mark the raw-HTTP check's bindings Final		2026-10-07 22:20:02 +00:00
..
azure_client_usage_test.py	fix - correctly re-use azure openai client	2025-03-18 09:51:28 -07:00
ban_constant_numbers.py	Squashed commit of the following: (#9709)	2025-04-02 21:24:54 -07:00
ban_copy_deepcopy_kwargs.py	Fix - using managed files w/ OTEL + UI - add model group alias on UI (#13171)	2025-07-31 21:22:04 -07:00
bedrock_pricing.py	Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_ruff_dead_test_code	2026-08-24 09:46:56 -07:00
callback_manager_test.py	(Refactor / QA) - Use LoggingCallbackManager to append callbacks and ensure no duplicate callbacks are added (#8112)	2025-01-30 19:35:50 -08:00
check_data_replace_usage.py	Bug fix - String data: stripped from entire content in streamed Gemini responses (#9070)	2025-03-07 21:06:39 -08:00
check_e2e_no_raw_requests.py	test(e2e): move the harness self-tests out of tests/e2e (#45172)	2026-10-07 22:20:02 +00:00
check_endpoint_coverage.py	Revert "[Feature] Add /public/supported_endpoints endpoint"	2026-02-26 17:21:43 -08:00
check_fastuuid_usage.py	code cov test script check_fastuuid_usage.py	2025-09-24 10:27:22 +09:00
check_get_model_cost_key_performance.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
check_guardrail_apply_decorator.py	content filter test fix	2026-02-12 17:54:16 -08:00
check_licenses.py	feat(proxy): embed enterprise LiteAdmin MCP in LiteLLM images (#44610)	2026-10-05 15:24:34 -07:00
check_migrations_no_data_rewrites.py	fix(proxy-extras): build the SpendLogs indexes in the migration job instead of in migrations (#43948)	2026-10-01 14:12:22 -07:00
check_no_publicly_known_master_key.py	fix(ci): skip the generated dashboard bundle in the master key guard (#44890)	2026-10-06 18:15:09 +00:00
check_prisma_binary_cache.py	fix(ci): bound setup steps so pytest always gets its full budget	2026-08-10 16:22:07 +00:00
check_provider_folders_documented.py	feat(harness): add Harness.TOOL_LOOP, a minimal in-process tool-calling loop (#44391)	2026-10-03 17:33:01 +00:00
check_py310_typing_imports.py	fix: keep litellm importable on Python 3.10 and guard 3.11-only typing imports in CI (#39448)	2026-09-02 18:27:19 -07:00
check_spanattributes_value_usage.py	test: drop the cwd-relative sys.path.insert calls from the test suite (#37802)	2026-08-22 09:25:58 -07:00
check_unbounded_in_lists.py	ci: fail on new unbounded SQL IN lists and add a Prisma chunking helper (#42629)	2026-09-26 13:40:44 -07:00
check_unsafe_enterprise_import.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
check_workflow_job_name_collisions.py	fix(ci): keep an expression matrix directive out of the comparison	2026-09-06 02:59:16 -07:00
check_workflow_startup_safety.py	fix(ci): report budgets the startup guard cannot resolve	2026-08-10 18:12:18 +00:00
code_qa_check_tests.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
enforce_llms_folder_style.py	test: drop the cwd-relative sys.path.insert calls from the test suite (#37802)	2026-08-22 09:25:58 -07:00
ensure_async_clients_test.py	refactor(lens)!: rename internal engine code and API (#44034)	2026-10-01 11:02:14 -07:00
info_log_check.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
liccheck.ini	feat(proxy): embed enterprise LiteAdmin MCP in LiteLLM images (#44610)	2026-10-05 15:24:34 -07:00
license_cache.json	fix(deps): update python-multipart to >=0.0.20 in CI and test configs	2026-03-03 15:10:39 -03:00
litellm_logging_code_coverage.py	docs(litellm_logging_code_coverage.py): fix check	2025-06-18 21:36:03 -07:00
log.txt	Squashed commit of the following: (#9709)	2025-04-02 21:24:54 -07:00
memory_test.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
pass_through_code_coverage.py	test: initial commit enforcing testing on all anthropic pass through … (#7794)	2025-01-15 22:02:35 -08:00
prevent_key_leaks_in_exceptions.py	fix(main.py): fix key leak error when unknown provider given (#8556)	2025-02-15 14:02:55 -08:00
recursive_detector.py	fix(router): preserve native baseline identity and accounting (#44960)	2026-10-07 11:00:31 -07:00
router_code_coverage.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
router_enforce_line_length.py	Litellm router code coverage 3 (#6274)	2024-10-16 21:30:25 -07:00
test_aio_http_image_conversion.py	fix img URL for tests	2025-11-22 09:41:15 -08:00
test_ban_set_verbose.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_chat_completion_imports.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_check_no_publicly_known_master_key.py	fix(ci): skip the generated dashboard bundle in the master key guard (#44890)	2026-10-06 18:15:09 +00:00
test_e2e_changed_gate.py	ci: move Postgres, MCP and Redis suites to CircleCI integration (#44453)	2026-10-05 09:33:14 -07:00
test_e2e_idp_stack.py	test(e2e): verify IdP readiness through real HTTP	2026-09-11 17:25:38 -07:00
test_e2e_junit_report.py	test(e2e): typed per-test metadata for the e2e suite (#42044)	2026-09-30 21:03:21 -07:00
test_e2e_metadata.py	test(e2e): add enum values, auto-discovering label gates and secret hiding for e2e metadata (#44949)	2026-10-06 17:03:35 -07:00
test_merge_smoke.py	ci: add merge smoke checks workflow with loopback-only harness and 11 curated cases (#42709)	2026-09-23 11:01:08 -07:00
test_no_hardcoded_secrets.py	test: run the 30 test files stranded in the second mirror (#37595)	2026-08-20 10:59:43 -07:00
test_provider_cache.py	fix(e2e): own a shared fixture's deployment by the fixture's node, not the first test	2026-09-16 17:35:05 -07:00
test_provider_replay_harness.py	test(e2e): move the harness self-tests out of tests/e2e (#45172)	2026-10-07 22:20:02 +00:00
test_proxy_types_import.py	refactor(logging): load enterprise alerting loggers lazily so import litellm skips proxy types (#44762)	2026-10-05 22:06:53 -07:00
test_router_strategy_async.py	test: drop the cwd-relative sys.path.insert calls from the test suite (#37802)	2026-08-22 09:25:58 -07:00
test_workflow_job_name_collisions.py	fix(ci): keep an expression matrix directive out of the comparison	2026-09-06 02:59:16 -07:00
unbounded_in_baseline.txt	fix(projects): show Projects to team and org admins and scope it correctly (#41325)	2026-10-06 14:33:31 -07:00
user_api_key_auth_code_coverage.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00