yucheng-berri 55726b91c8 perf(router): read cooldown state only for the request's candidate deployments ... Routing used to read the cooldown key of every deployment on the router on each request, so the Redis MGET and the in-memory scan grew with the size of the whole model list. The cooldown reads on the routing path now take the ids of the request's own deployments, and the proxy's routing prefetch arms the cooldown keys of the route's team-aware candidates instead of every id. The no-deployments error paths keep reading every deployment, so the cooldown_list in the 429 message is unchanged. Resolves LIT-9861		2026-10-20 10:12:27 -07:00
..
__init__.py	ci: move caching, proxy-extras, gateway and enterprise tests into tests/unit and run them from litellm-tests (#42902)	2026-09-24 15:49:59 -07:00
test_azure_blob_cache.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_cache_preset_key.py	ci: move caching, proxy-extras, gateway and enterprise tests into tests/unit and run them from litellm-tests (#42902)	2026-09-24 15:49:59 -07:00
test_caching.py	feat(gemini): allow disabling thought summaries while keeping thinking on (#36460)	2026-10-16 09:01:33 +00:00
test_caching_handler.py	test(caching): assert sync cache-hit logging without depending on thread order (#47093)	2026-10-17 14:00:03 -07:00
test_check_and_fix_namespace_none_guard.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_disk_cache.py	test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e (#45940)	2026-10-11 06:24:57 -07:00
test_dual_cache.py	fix(caching): make Redis Cluster commands wait for a pool slot instead of tripping the circuit breaker (#46488)	2026-10-14 15:27:00 -07:00
test_embedding_router.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_evicted_client_closer.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_gcs_cache.py	test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e (#45940)	2026-10-11 06:24:57 -07:00
test_in_memory_cache.py	fix(router): keep the prompt caching affinity pin alive as long as the prefix's cache_control ttl (#46084)	2026-10-14 21:10:09 -07:00
test_llm_caching_handler.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_llm_client_cache_e2e.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_qdrant_semantic_cache.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_redis_batch.py	perf(router): read cooldown state only for the request's candidate deployments	2026-10-20 10:12:27 -07:00
test_redis_cache.py	test(caching): baseline breaker metrics from live state after gc (#46652)	2026-10-15 05:53:30 -07:00
test_redis_cluster_cache.py	fix(caching): make Redis Cluster commands wait for a pool slot instead of tripping the circuit breaker (#46488)	2026-10-14 15:27:00 -07:00
test_redis_cluster_node_isolation.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_redis_connection_pool.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_redis_semantic_cache.py	fix(caching): skip the cache past max_messages and keep tool_result text in semantic prompts (#43878)	2026-10-07 17:32:39 +00:00
test_request_redis_batch_post_call.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_request_redis_batch_pre_call.py	perf(router): read cooldown state only for the request's candidate deployments	2026-10-20 10:12:27 -07:00
test_responses_stream_cache_keys.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_s3_cache.py	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
test_unit_test_caching.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_valkey_semantic_cache.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00