jesco 3057c47d6d fix(caching): keep reasoning, citations, and audio on streamed cache hits (#32096) ... * fix(proxy): preserve reasoning fields on streaming cache hits * fix(proxy): validate cached streaming delta fields Signed-off-by: jesco-absolut <team@srswti.com> * fix(caching): replay cached audio, images, reasoning and citations in stream order A cached answer replayed as a stream now ends with its own empty finish chunk, so a chunk that carries only audio or images keeps its payload and role. Reasoning fields lead on a chunk with no text, and annotations arrive once on the last text slice, matching a live stream's order. * fix(caching): replay a cached tool call after the text, like a live stream Only the role, reasoning fields and provider fields lead a replayed answer. Tool calls now arrive on their own chunk after the last text slice, and logprobs ride the first text chunk, so a cached answer with reasoning and a tool call keeps a live stream's reasoning, text, tool call order. * fix(caching): replay the reasoning before a cached tool call that has no text A cached answer that thinks and then only calls a tool now replays its reasoning on its own chunk before the tool call, the order a live stream sends, instead of one chunk carrying both. * fix(caching): keep blank-only text when replaying a cached answer with reasoning A cached answer that thinks, sends only whitespace as text, and then calls a tool now replays that whitespace between the reasoning and the tool call, instead of dropping it. --------- Signed-off-by: jesco-absolut <team@srswti.com> Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>		2026-10-29 10:08:12 -07:00
..
response_cache_case.py	fix(caching): keep reasoning, citations, and audio on streamed cache hits (#32096)	2026-10-29 10:08:12 -07:00
test_cache_max_messages.py	test(integration): look up owned cache keys and clean up sweep models (#47255)	2026-10-18 10:27:53 +00:00
test_embedding_file_block_cache.py	feat(gemini): accept file content blocks with video_metadata on multimodal embeddings (#45305)	2026-10-08 13:20:03 -07:00
test_in_memory_cache_heap_bound.py	fix(router): keep the prompt caching affinity pin alive as long as the prefix's cache_control ttl (#46084)	2026-10-14 21:10:09 -07:00
test_response_cache_chaos.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_response_cache_empty_output.py	fix(caching): never store or serve a chat completion with no choices (#44709)	2026-10-06 20:07:30 +00:00
test_response_cache_model_group_key.py	fix(caching): read the cache key's model group from the router's metadata for the call (#48917)	2026-10-29 05:35:23 -07:00
test_response_cache_stream_replay.py	fix(caching): keep reasoning, citations, and audio on streamed cache hits (#32096)	2026-10-29 10:08:12 -07:00