devin-ai-integration[bot] 321be01877 fix(caching): write the response-cache SET to Redis at once instead of on the post-call batch (#43973) ... * fix(caching): write the response-cache SET to Redis at once instead of on the post-call batch The post-call Redis batch only goes out after every success callback finishes or the 1s deadline, so an identical request sent right after the first response missed the cache and went to the provider again. Response-cache writes go straight to Redis again, the counters, rate limits, TPM and slot releases keep riding the post-call batch Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(caching): re-export DualCache explicitly instead of through a noqa Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(caching): keep the DualCache re-export as a reasoned noqa for the strict ruff gate Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> --------- Co-authored-by: yassin <yassin@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>		2026-09-30 20:39:48 -07:00
..
__init__.py
test_azure_blob_cache.py
test_cache_preset_key.py
test_caching.py	fix(params): validate stream_chunk_size once, before any provider call (#43222)	2026-09-26 23:01:20 +00:00
test_caching_handler.py	fix(otel): detach post-response service spans by request phase, name redis spans by operation (#43237)	2026-09-26 10:10:12 -07:00
test_check_and_fix_namespace_none_guard.py
test_disk_cache.py
test_dual_cache.py	perf(router): honour the cooldown read interval in the routing prefetch (#43815)	2026-09-30 00:29:20 -07:00
test_embedding_router.py
test_evicted_client_closer.py
test_gcs_cache.py
test_in_memory_cache.py
test_llm_caching_handler.py
test_llm_client_cache_e2e.py
test_qdrant_semantic_cache.py
test_redis_batch.py	perf(proxy): refresh auth management objects through the request Redis pipeline (#43776)	2026-09-29 17:56:31 -07:00
test_redis_cache.py	fix(ci): stop stale CI reds, keep unit tests off the host env, retry CyberArk policy conflicts (#43294)	2026-09-26 09:25:13 -07:00
test_redis_cluster_cache.py
test_redis_cluster_node_isolation.py
test_redis_connection_pool.py
test_redis_semantic_cache.py
test_request_redis_batch_post_call.py	fix(caching): write the response-cache SET to Redis at once instead of on the post-call batch (#43973)	2026-09-30 20:39:48 -07:00
test_request_redis_batch_pre_call.py	perf(router): honour the cooldown read interval in the routing prefetch (#43815)	2026-09-30 00:29:20 -07:00
test_responses_stream_cache_keys.py
test_s3_cache.py
test_unit_test_caching.py
test_valkey_semantic_cache.py