mika-lt ebf84f8649 fix(caching): read the cache key's model group from the router's metadata for the call (#48917) ... * test(caching): audit #44542 response cache model group key * fix(caching): key the response cache by the router's metadata bucket only * fix(caching): read the router's model group before the caller's metadata * fix(caching): read caching groups only beside the router's model group A caller's own metadata.caching_groups on /v1/responses and /v1/messages could still pick the cache key, so a string group let one model group fill another's entry. The key now reads caching_groups only from the metadata that holds the router's model_group. * test(caching): type the planted caching groups parameter * fix(caching): read the model group from the metadata that carries the call's deployment A router call can carry a litellm_metadata it did not write, from the auto router's classifier embedding or an SDK caller, while the router writes its own group into metadata. The cache now picks the metadata source whose model_info matches the call's deployment, then falls back to the previous order. * fix(caching): keep main's model group lookup for calls outside the router --------- Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>		2026-10-29 05:35:23 -07:00
..
response_cache_case.py	test(integration): look up owned cache keys and clean up sweep models (#47255)	2026-10-18 10:27:53 +00:00
test_cache_max_messages.py	test(integration): look up owned cache keys and clean up sweep models (#47255)	2026-10-18 10:27:53 +00:00
test_embedding_file_block_cache.py	feat(gemini): accept file content blocks with video_metadata on multimodal embeddings (#45305)	2026-10-08 13:20:03 -07:00
test_in_memory_cache_heap_bound.py	fix(router): keep the prompt caching affinity pin alive as long as the prefix's cache_control ttl (#46084)	2026-10-14 21:10:09 -07:00
test_response_cache_chaos.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_response_cache_empty_output.py	fix(caching): never store or serve a chat completion with no choices (#44709)	2026-10-06 20:07:30 +00:00
test_response_cache_model_group_key.py	fix(caching): read the cache key's model group from the router's metadata for the call (#48917)	2026-10-29 05:35:23 -07:00