litellm/tests/e2e
yuneng-jiang 222756d2db
test(e2e): remove the secret manager suite (#51241)
The secret manager lanes ran the proxy against a Vault dev container and a
Conjur container that we start ourselves, so nothing in them needed a real
third-party service. They have not run a single test since late October,
because the co-located proxy cannot boot in the lane pod, and they were
soft_fail outside the promotion gate, so they only added noise.

The AWS test in the folder was skipped on every lane, since no aws lane
ever existed.

The four coverage registry rows go with the tests, because the registry is
the e2e denominator and this behavior belongs in the integration tier if it
gets covered again. The Vault and CyberArk clients keep their unit tests.

(cherry picked from commit 587902becf)
2026-11-11 15:05:21 -08:00
..
a2a test(e2e): backport owned A2A integration coverage to rc 108 2026-11-03 14:38:59 -08:00
access_control fix(proxy/auth): expand all-team-models sentinel for project model access checks (#43734) 2026-10-10 15:49:27 -07:00
batches test(e2e): backport qualification repairs to rc 1.108.0 2026-11-03 13:35:26 -08:00
claude_code test(e2e): retire the quiet_stack lock and batch the claude_code model registration (#49984) 2026-11-06 17:27:13 -08:00
coverage_registry test(e2e): remove the secret manager suite (#51241) 2026-11-11 15:05:21 -08:00
gateway test(e2e): remove the secret manager suite (#51241) 2026-11-11 15:05:21 -08:00
guardrails test(integration): backport Presidio Sail and Weave migrations to rc 108 2026-11-03 14:23:50 -08:00
llm_translation test(e2e): repin the Together reasoning replay backend to MiniMax-M3.1-Flash 2026-11-07 17:08:44 -08:00
logging test(integration): backport Presidio Sail and Weave migrations to rc 108 2026-11-03 14:23:50 -08:00
management fix(proxy): backport the 1.107.0 rc triage fixes to rc/1.107.0 (#47043) 2026-10-16 19:03:48 -07:00
mcp test(mcp): replace the live Linear MCP OAuth e2e tests with integration coverage (#47154) 2026-11-06 17:40:33 -08:00
migrations refactor(helm)!: connect both charts to a separately deployed Lens 2026-10-29 19:28:56 -07:00
other fix(proxy): enforce the personal max_budget on proxy-admin JWTs (#43070) 2026-10-12 16:04:12 -07:00
perf test(e2e): retire the quiet_stack lock and batch the claude_code model registration (#49984) 2026-11-06 17:27:13 -08:00
quota_management test(e2e): retire the quiet_stack lock and batch the claude_code model registration (#49984) 2026-11-06 17:27:13 -08:00
router test(e2e): retire the quiet_stack lock and batch the claude_code model registration (#49984) 2026-11-06 17:27:13 -08:00
ui test(e2e): backport qualification repairs to rc 1.108.0 2026-11-03 13:35:26 -08:00
AGENTS.md test(e2e): remove the secret manager suite (#51241) 2026-11-11 15:05:21 -08:00
conftest.py test(e2e): remove the secret manager suite (#51241) 2026-11-11 15:05:21 -08:00
CONTRIBUTING.md test(e2e): remove the secret manager suite (#51241) 2026-11-11 15:05:21 -08:00
e2e_config.py test(e2e): remove the secret manager suite (#51241) 2026-11-11 15:05:21 -08:00
e2e_db.py test(e2e): guard destructive spend-log truncate behind an explicit opt-in (#33751) 2026-07-20 08:47:39 -07:00
e2e_http.py test(e2e): perf rig (out-of-process mocks, PerformanceTestCase runner, per-request limits) and the small_bodies_5rps case (#46713) 2026-10-15 20:14:40 +00:00
e2e_metadata.py test(e2e): add enum values, auto-discovering label gates and secret hiding for e2e metadata (#44949) 2026-10-06 17:03:35 -07:00
fixture_bundle.py test: add strict stateless provider replay identity 2026-09-14 16:55:43 -07:00
fixture_canonical.py feat(e2e): key the provider cache per test and mount Bedrock behind it 2026-09-16 02:15:46 -07:00
fixture_mode.py fix(e2e): own a shared fixture's deployment by the fixture's node, not the first test 2026-09-16 17:35:05 -07:00
fixture_profile.py test: preserve strict replay numeric spelling 2026-09-14 17:11:56 -07:00
idp.py test(e2e): add enum values, auto-discovering label gates and secret hiding for e2e metadata (#44949) 2026-10-06 17:03:35 -07:00
idp_realm.json test(e2e): harden JWT fixtures and cover management lifecycles 2026-09-11 16:36:12 -07:00
junit_properties.py test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
lifecycle.py test(e2e): add enum values, auto-discovering label gates and secret hiding for e2e metadata (#44949) 2026-10-06 17:03:35 -07:00
memory_readings.py test(e2e): hold every worker under an idle RSS budget before any traffic (#42552) 2026-09-22 14:47:14 -07:00
models.py test(mcp): replace the live Linear MCP OAuth e2e tests with integration coverage (#47154) 2026-11-06 17:40:33 -08:00
otel_client.py test(e2e): backport qualification repairs to rc 1.108.0 2026-11-03 13:35:26 -08:00
PROVIDER_CACHE.md test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
provider_cache.py fix(e2e): bind provider-cache recordings to the deployment's test, not the serving process 2026-09-16 17:08:17 -07:00
provider_cache_redis.py test(e2e): backport qualification repairs to rc 1.108.0 2026-11-03 13:35:26 -08:00
provider_cache_routing.py revert(e2e): unmount Gemini, its api_base means two things 2026-09-16 08:37:25 -07:00
provider_edge.py test(e2e): record steps for raw transport calls and poll helpers (#45150) 2026-10-07 15:21:26 -07:00
provider_edge_bedrock.py fix(bedrock)!: replay redacted_thinking on Converse and keep its data as Claude's own string (#46532) 2026-10-14 19:08:14 -07:00
proxy_client.py test(e2e): retire the quiet_stack lock and batch the claude_code model registration (#49984) 2026-11-06 17:27:13 -08:00
pytest.ini test(e2e): remove the secret manager suite (#51241) 2026-11-11 15:05:21 -08:00
transport.py test(e2e): record steps for raw transport calls and poll helpers (#45150) 2026-10-07 15:21:26 -07:00