6 commits

Author	SHA1	Message	Date
Yassin Kortam	765fd0762e	fix(responses): stop scheduling sync success_handler concurrently with async_success_handler (#32239)	2026-07-07 09:13:50 -07:00
yucheng-berri	8449ecee6a	fix(streaming): stamp completion_start_time on first chunk for /v1/messages and /v1/responses (#32284) ... Streaming pass-through for native Anthropic /v1/messages and the /v1/responses streaming iterator never set logging_obj.completion_start_time, so _success_handler_helper_fn fell back to completion_start_time = end_time. Downstream TTFT consumers (Prometheus, OTEL, Langfuse, Admin UI, spend logs completionStartTime) then reported time-to-first-token equal to total request duration. Stamp completion_start_time on the first chunk in PassThroughStreamingHandler. chunk_processor and BaseResponsesAPIStreamingIterator._process_chunk, mirroring CustomStreamWrapper for /chat/completions. Resolves LIT-4185 Co-authored-by: yucheng <yucheng@yuchengs-MBP.localdomain>	2026-07-06 19:30:31 -07:00
Sameer Kankute	15288f3ae7	test: include response key in response.completed chunk for ID hook test ... _base_process_chunk only encodes response IDs when parsed_chunk contains a top-level "response" key. Align test_process_chunk_completed_response_ updates_id_and_usage_cost with that contract and test_base_responses_api_streaming_iterator. Made-with: Cursor	2026-05-01 15:41:17 +05:30
Noah	8947a74e13	fix(cache): persist and replay streamed Responses API requests (#24580) ... * fix(cache): persist and replay streamed Responses API requests * Add focused coverage for streamed responses cache * Cover streamed responses cache helper branches * Exercise streamed responses cache edge branches	2026-05-01 11:55:36 +05:30
Ishaan Jaffer	e8461b5b97	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
LingXuanYin	499fc9f48a	Align responses API streaming hooks with chat pipeline	2026-01-06 10:54:19 +08:00