litellm/tests/e2e_harness
yuneng-jiang 91fc6c2071
test(e2e): drop two batch waits that never finish in time (#51882)
cleanup_batch waited up to 120s for a managed batch that was still
cancelling to reach a terminal state. Across 55 saved litellm-e2e builds it
reached one in time once, so test_batch_lifecycle[openai-unified] spent 126s
and TestBatchSecondHop 140s on every run, and both then left the input file
in place anyway. A managed batch still cancelling is now left alone, the same
as a raw provider batch, and the input file cleanup still reports the
leftover.

TestBatchTerminalState listed the marker batches every 10s for up to 300s.
Each e2e stack starts with an empty database, so the list only ever holds
this run's own marker, which never completed inside the window in any of
those builds, and the test took 303s for its documented vacuous pass. It now
lists once.
2026-11-14 21:41:43 -08:00
..
batches test(e2e): drop two batch waits that never finish in time (#51882) 2026-11-14 21:41:43 -08:00
claude_code test(e2e): share the coding-CLI harness between suites (#49370) 2026-11-02 13:50:56 -08:00
cli_harness test(e2e): share the coding-CLI harness between suites (#49370) 2026-11-02 13:50:56 -08:00
codex test(e2e): add a Codex row where a sub-agent must read the task its parent hands it (#50494) 2026-11-07 21:16:39 +00:00
coverage_registry test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
guardrails test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
logging test(e2e): move audio, realtime, and Langfuse tests off model ids with shutdown dates (#51816) 2026-11-14 09:51:53 -05:00
perf test(perf): remove the database_upgrade_5rps e2e case and its harness tests (#50076) 2026-11-04 10:39:46 -08:00
AGENTS.md test(e2e): retire the quiet_stack lock and batch the claude_code model registration (#49984) 2026-11-04 09:55:53 -08:00
pytest.ini fix(e2e): restore main qualification across providers and UI (#49763) 2026-11-03 20:38:47 +00:00
test_e2e_http.py test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
test_fixture_bundle.py test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
test_fixture_canonical.py test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
test_fixture_mode.py test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
test_idp.py test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
test_junit_properties.py test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
test_provider_edge.py test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
test_proxy_client.py test(e2e): retire the quiet_stack lock and batch the claude_code model registration (#49984) 2026-11-04 09:55:53 -08:00