scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-08 22:21:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 78
litellm/tests/test_litellm/caching
History
Exact
Cursor Agent 185e2b9a21 test: add e2e regression tests with OpenAI SDK clients for cache eviction safety 
Add two new tests using real AsyncOpenAI SDK clients (the exact production
path) that verify clients remain usable after cache eviction:

- test_evicted_openai_sdk_client_stays_usable: size-based eviction
- test_ttl_expired_openai_sdk_client_stays_usable: TTL-based eviction

All four e2e tests now sleep after eviction to drain any background
close tasks — without this sleep, a regression that schedules close via
create_task() would go undetected (the original tests passed by luck).

Co-authored-by: Ishaan Jaff <ishaan-jaff@users.noreply.github.com>
2026-03-05 19:20:35 +00:00
..
test_azure_blob_cache.py add azure blob cache support (#12587) 2025-07-15 11:47:38 -07:00
test_caching_handler.py Helicone base url support + fix for embedding cache hits on str input (#11211) 2025-05-28 22:02:55 -07:00
test_dual_cache.py fix(cache): prevent DualCache async batch check-then-act race (#20986) 2026-02-13 18:32:41 +05:30
test_gcs_cache.py Add GCS bucket caching support (#13122) 2025-08-04 16:09:33 -07:00
test_in_memory_cache.py [Performance] Reduce complexity of InMemoryCache.evict_cache from O(n*log(n)) to O(log(n)) (#15000) 2025-09-30 16:49:35 -07:00
test_llm_caching_handler.py fix: remove cache eviction close that kills in-use httpx clients 2026-03-05 18:49:59 +00:00
test_llm_client_cache_e2e.py test: add e2e regression tests with OpenAI SDK clients for cache eviction safety 2026-03-05 19:20:35 +00:00
test_qdrant_semantic_cache.py feat(semantic-cache): support configurable vector dimensions for Qdrant (#21649) 2026-02-21 00:51:15 -08:00
test_redis_cache.py fix(proxy): add LPOP pipeline error checking and fix org spend ServiceType 2026-02-24 14:22:57 -08:00
test_redis_cluster_cache.py Litellm fix GitHub action testing (#11163) 2025-05-26 14:41:42 -07:00
test_redis_connection_pool.py Revert "Add LLMClientCache regression tests for httpx client eviction safety" 2026-02-27 12:43:03 -08:00
test_redis_semantic_cache.py Litellm fix GitHub action testing (#11163) 2025-05-26 14:41:42 -07:00
test_s3_cache.py verify expires field prior to serving cache entry 2025-08-25 10:42:12 +02:00