litellm/tests/e2e/llm_translation/realtime
Yuneng Jiang a215ecaf3d
fix(e2e): move the vertex realtime suite off the retired Live preview model
Google withdrew gemini-live-2.5-flash-preview-native-audio-09-2025 from the
Vertex Live API. Every session dies at setup:

  received 1007 (invalid frame payload data)
  gemini-live-2.5-flash-preview-native-audio-09-2025 is not supported in the live api.

The client sees session.created (the proxy synthesizes it on connect) and then
nothing, so both vertex_ai realtime tests time out waiting for session.updated.

Confirmed by probing the Vertex Live endpoint directly with the e2e stack's own
credentials:

  gemini-live-2.5-flash-preview-native-audio-09-2025 -> 1007, not supported
  gemini-live-2.5-flash-native-audio                 -> setupComplete

so this swaps to the non-preview sibling, which is the same native-audio class
and is what the cost map already carries for vertex_ai.

Not a litellm regression. The suspicion fell on #38395 because it removed the
native-audio speechConfig strip, but the setup payload this suite sends is
byte-identical either side of that change: the strip only fires when a client
sends a voice, and the e2e SessionConfig has no voice field. Google's rejection
names the model, not a field.

The gemini (Google AI Studio) provider keeps the -09-2025 id, which still works
there; only the Vertex endpoint dropped it.
2026-08-26 20:58:38 -07:00
..
fixtures test: litellm fix failing tests (#32577) 2026-07-09 13:54:45 -07:00
conftest.py test(e2e): rename Gateway to ProxyClient and expose it as a session-scoped fixture (#33750) 2026-07-18 18:41:18 +00:00
pipecat_service.py test: litellm fix failing tests (#32577) 2026-07-09 13:54:45 -07:00
realtime_client.py fix(e2e): move the vertex realtime suite off the retired Live preview model 2026-08-26 20:58:38 -07:00
REALTIME_COVERAGE_MATRIX.md fix(e2e): move the vertex realtime suite off the retired Live preview model 2026-08-26 20:58:38 -07:00
test_realtime_bedrock_e2e.py fix(bedrock): emit Nova Sonic realtime session.created on connect and session.updated on session.update (#34133) 2026-07-22 06:15:37 +00:00
test_realtime_e2e.py docs(tests/e2e): align docs with the hard-fail-on-dead-proxy contract and scope the no-unit-tests rule (#33755) 2026-07-17 12:56:10 -07:00
test_realtime_pipecat_audio_e2e.py [e2e] Pin the OpenAI websocket passthrough prefixes 2026-08-21 17:26:18 -07:00
test_realtime_pipecat_e2e.py [e2e] Pin the OpenAI websocket passthrough prefixes 2026-08-21 17:26:18 -07:00