yuneng-jiang 24afa12253 chore(caching)!: remove the disk cache backend (#48114) ... * chore(caching)!: remove the disk cache backend Drop the disk cache type and its diskcache dependency, along with the caching install extra that existed only to pull it in. diskcache has not had a release since August 2023 Cache now raises a ValueError listing the supported types when it gets a type it does not know. Before, an unknown type built a Cache with no backend, which only failed on first use BREAKING CHANGE: cache_params type "disk" and the litellm[caching] extra are gone. A proxy configured with type disk now refuses to start. Use local or redis instead * test(proxy): expect the unsupported cache type error from _init_cache The test pinned the old fallthrough, where an unknown type left the cache without a backend and the proxy hit an AttributeError reading it * chore(deps): drop the diskcache scan ignore main extended diskcache is no longer in the lock, so the ignore matches nothing * fix(caching): ignore a leftover disk_cache_dir instead of crashing redis and s3 Dropping the disk_cache_dir parameter sent the key into **kwargs, which the redis and s3 branches hand to their clients, so a config that moved from the disk cache to redis or s3 and kept the key failed with a TypeError. Accept the key again, ignore it, and log a warning The unsupported type test now checks the whole supported list, and two proxy docstrings no longer name disk as a cache backend * fix(caching): warn about a leftover disk_cache_dir only once the cache is built The warning ran before the type check, so a config with type disk logged that the key was ignored and then failed on the type anyway. It now logs only after a supported backend is built. The test also checks that a cache without the key logs nothing		2026-10-29 18:02:31 -07:00
..
__init__.py
_event_loop_reuse.py	fix(caching): key cached async clients by a per-loop token instead of id(loop) (#48877)	2026-10-29 13:14:48 -07:00
test_azure_blob_cache.py
test_cache_preset_key.py
test_caching.py	chore(caching)!: remove the disk cache backend (#48114)	2026-10-29 18:02:31 -07:00
test_caching_handler.py	test(caching): assert sync cache-hit logging without depending on thread order (#47093)	2026-10-17 14:00:03 -07:00
test_check_and_fix_namespace_none_guard.py
test_dual_cache.py	fix(caching): make Redis Cluster commands wait for a pool slot instead of tripping the circuit breaker (#46488)	2026-10-14 15:27:00 -07:00
test_embedding_router.py	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
test_evicted_client_closer.py	fix(caching): key cached async clients by a per-loop token instead of id(loop) (#48877)	2026-10-29 13:14:48 -07:00
test_gcs_cache.py	test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e (#45940)	2026-10-11 06:24:57 -07:00
test_in_memory_cache.py	feat(router): add deployment rpd and tpd daily limits to enforce_model_rate_limits (#48875)	2026-10-28 15:52:44 -07:00
test_llm_caching_handler.py	fix(caching): key cached async clients by a per-loop token instead of id(loop) (#48877)	2026-10-29 13:14:48 -07:00
test_llm_client_cache_e2e.py
test_qdrant_semantic_cache.py	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
test_redis_batch.py	fix(otel): nest cache spans under their operation and name service spans by purpose (#44150)	2026-10-03 09:20:27 -07:00
test_redis_cache.py	test(caching): baseline breaker metrics from live state after gc (#46652)	2026-10-15 05:53:30 -07:00
test_redis_cluster_cache.py	fix(caching): make Redis Cluster commands wait for a pool slot instead of tripping the circuit breaker (#46488)	2026-10-14 15:27:00 -07:00
test_redis_cluster_node_isolation.py
test_redis_connection_pool.py
test_redis_semantic_cache.py	refactor(router): move router callers onto the entry points and invert the proxy imports (#48847)	2026-10-29 17:26:33 +00:00
test_request_redis_batch_post_call.py	fix(proxy)!: stop update_cache from resurrecting evicted auth cache entries (#46997)	2026-10-20 17:09:53 +00:00
test_request_redis_batch_pre_call.py	fix: cap cold MCP schema workers at usable CPUs and deflake wall-clock unit tests (#45791)	2026-10-15 00:47:59 -07:00
test_responses_stream_cache_keys.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_s3_cache.py	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
test_unit_test_caching.py	fix(caching): read the cache key's model group from the router's metadata for the call (#48917)	2026-10-29 05:35:23 -07:00
test_valkey_semantic_cache.py