shrey kharbanda 363cc0da04 fix(passthrough): bill a WebSocket session whose client hangs up mid-stream ... When a client closed its socket while the upstream was still sending, the relay's next send to the client raised, the session took the unexpected error path, the client got a 1011 close and the proxy wrote a failure row with no cost. The upstream had already done, and billed, the work A send to a client that has gone now ends the session the way a client disconnect does: the upstream is closed, the frames received so far reach the success handler and spend is logged once. Each upstream frame is recorded before it is sent, so the frame whose send failed is billed too. For Deepgram listen that can be the closing Metadata frame, which carries the session's duration. Starlette raises WebSocketDisconnect when the socket fails and uvicorn raises RuntimeError once the transport is closed, so both count as the client leaving Every WebSocket passthrough (Deepgram listen, Vertex Live, realtime) shares this relay. Text-to-speech makes it common, since callers hang up or barge in while audio is still streaming Refs LIT-10070		2026-10-27 09:01:14 -07:00
..
llm_provider_handlers	fix(opencode): bill OpenCode Go requests from the reported list_cost (#48254)	2026-10-24 16:44:29 -07:00
__init__.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_carry_guardrail_logging_info.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_codex_passthrough_endpoints.py	feat(chatgpt): forward client subscriptions through the gateway (#41522)	2026-10-26 15:44:05 -07:00
test_deepgram_ws_passthrough_routes.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_injected_stream_usage.py	fix(vllm): write spend log rows for /vllm passthrough calls to router models (#45733)	2026-10-14 12:40:48 -07:00
test_llm_pass_through_endpoints.py	fix(proxy): validate JSON object bodies before request handling (#48438)	2026-10-26 16:11:38 -07:00
test_llm_passthrough_endpoints.py	feat(proxy): map baggage values to budget tags (#47358)	2026-10-20 09:09:42 +00:00
test_managed_id_rewriter.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_method_specific_routing.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_pass_through_endpoints.py	fix(passthrough): bill a WebSocket session whose client hangs up mid-stream	2026-10-27 09:01:14 -07:00
test_passthrough_auth_default.py	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
test_passthrough_endpoint_router.py	fix(secret_managers)!: resolve oidc/file and oidc/env refs in admin-configured api_key per request (#47341)	2026-10-20 01:43:59 +00:00
test_passthrough_endpoints_common_utils.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_passthrough_guardrail_block_otel_span.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_passthrough_guardrails.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_passthrough_guardrails_field_targeting.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_passthrough_post_call_guardrails.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_streaming_handler.py	fix(router): log each dropped /v1/messages attempt through its own logging copy and open the retry without its usage (#45194)	2026-10-20 21:46:45 -07:00
test_streaming_handler_interrupt.py	fix(router): log each dropped /v1/messages attempt through its own logging copy and open the retry without its usage (#45194)	2026-10-20 21:46:45 -07:00
test_success_handler.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_upstream_usage_headers.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_vertex_ai_batch_passthrough.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_vertex_ai_live_passthrough.py	test: move 81 legacy live tests in pass-through, spend, batches, audio, search, guardrails, image and ocr dirs offline (#45288)	2026-10-08 02:38:12 -07:00
test_vertex_passthrough_load_balancing.py	feat(vertex_ai): let operators drop chosen anthropic-beta values on the Vertex AI pass-through routes (#47185)	2026-10-18 12:51:27 +00:00
test_watsonx_proxy_route.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00