scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-28 06:23:07 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 94

Merge 9525e8609c into b6f91a221b

Browse source
This commit is contained in:
yetuge 2026-10-21 14:30:29 +00:00 • committed by GitHub
commit 71be8728d3
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 4 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
litellm/caching/redis_semantic_cache.py
View file

@ -81,8 +81,10 @@ class RedisSemanticCache(BaseCache):
embedding; defaults to the Router deployment's configured max_input_tokens
embedding_timeout: Seconds a cache lookup may spend embedding the prompt before it
gives up and lets the request continue to the LLM
ttl: Default time-to-live for cache entries in seconds
**kwargs: Additional arguments passed to the Redis client
**kwargs: Additional constructor arguments are accepted but currently
unused. Cache-entry TTL is not a constructor setting: _get_ttl reads
a `ttl` from the kwargs of each set_cache/async_set_cache call, so a
TTL applies to that individual cache write only
Raises:
Exception: If similarity_threshold is not provided or required Redis