litellm/tests/e2e
mateo-berri 94add306ad fix(e2e): recover realtime suite; fail fast on error events, defer-setup flag, pipecat pin
collect_until now fails immediately with the payload when the server sends an
error event instead of waiting out the timeout and reporting the opaque
"no 'session.created' within 20s; got ['error']" from the stage logs (LIT-4482).

The compose stack sets LITELLM_GEMINI_LIVE_DEFER_SETUP=true: the suite configures
sessions through the client's first session.update, which only reaches Gemini Live
in deferred-setup mode; without it every gemini/vertex raw-ws cell times out
waiting for session.updated.

test_pipecat_tool_smoke seeds the same tool-use instruction the raw-ws tool test
uses so the smoke no longer depends on the model spontaneously calling the tool.

pipecat is pinned to <1.5 with an import-time guard: 1.5.0 breaks the
azure/gemini/vertex realtime paths through the proxy (LIT-4511 tracks proxy-side
compat so the pin can be dropped).
2026-07-16 15:24:55 -07:00
..
access_control test(e2e): migrate access-control and inference-endpoint regression tests (#32016) 2026-07-05 01:39:10 +00:00
batches fix(e2e): bound spend-log snapshots to a /spend/logs/v2 window (#33265) 2026-07-14 13:32:10 -07:00
claude_code feat(e2e): emit structured E2E_RESULT lines for package status history (#33578) 2026-07-16 15:01:01 -07:00
coverage_registry feat(e2e): emit structured E2E_RESULT lines for package status history (#33578) 2026-07-16 15:01:01 -07:00
grafana feat(e2e): emit structured E2E_RESULT lines for package status history (#33578) 2026-07-16 15:01:01 -07:00
llm_translation fix(e2e): recover realtime suite; fail fast on error events, defer-setup flag, pipecat pin 2026-07-16 15:24:55 -07:00
logging chore(e2e): establish litellm_e2e_staging integration line (#33502) 2026-07-16 12:09:24 -07:00
management chore(e2e): establish litellm_e2e_staging integration line (#33502) 2026-07-16 12:09:24 -07:00
quota_management refactor: make the code easier to read 2026-07-14 13:58:23 -07:00
router fix(complexity_router): return empty dict from _classifier_call_metadata when metadata is absent (#33452) 2026-07-15 17:46:00 -07:00
bob_the_builder.py test: litellm fix failing tests (#32577) 2026-07-09 13:54:45 -07:00
CLAUDE.md feat(e2e): emit structured E2E_RESULT lines for package status history (#33578) 2026-07-16 15:01:01 -07:00
conftest.py feat(e2e): emit structured E2E_RESULT lines for package status history (#33578) 2026-07-16 15:01:01 -07:00
CONTRIBUTING.md ci: gate tests/e2e on zero basedpyright errors in pre-commit and lint CI 2026-07-11 10:25:22 -07:00
docker-compose.yml fix(e2e): recover realtime suite; fail fast on error events, defer-setup flag, pipecat pin 2026-07-16 15:24:55 -07:00
e2e_config.py test(e2e): datadog log delivery for successful chat, messages, and responses (LIT-4447) (#33415) 2026-07-16 09:54:07 -07:00
e2e_gateway.py fix(e2e/claude_code): unblock stage collection, align proxy env names, register compat models (#33433) 2026-07-16 11:05:31 -07:00
e2e_http.py test(e2e): otel trace completeness on streaming chat, messages, and responses (LIT-3787) (#33234) 2026-07-14 20:23:54 -07:00
e2e_result_reporter.py feat(e2e): emit structured E2E_RESULT lines for package status history (#33578) 2026-07-16 15:01:01 -07:00
lifecycle.py test(e2e): add live batches suite across providers and routing scenarios (#30958) 2026-07-02 08:05:23 -07:00
models.py fix(e2e/claude_code): unblock stage collection, align proxy env names, register compat models (#33433) 2026-07-16 11:05:31 -07:00
pytest.ini refactor(e2e): move budgets and spend_tracking suites under quota_management 2026-07-11 16:14:21 -07:00
transport.py test(e2e): probe the full spend read surface including schema-hidden routes (#32267) 2026-07-06 14:02:05 -07:00