scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-09 03:18:44 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 109

Merge f049d8c223 into e768ad55ce

Browse source
This commit is contained in:
yetuge 2026-10-03 08:11:36 -04:00 • committed by GitHub
commit e5cc9212ca
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 3 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
litellm/caching/redis_semantic_cache.py
View file

@ -81,8 +81,9 @@ class RedisSemanticCache(BaseCache):
embedding; defaults to the Router deployment's configured max_input_tokens
embedding_timeout: Seconds a cache lookup may spend embedding the prompt before it
gives up and lets the request continue to the LLM
ttl: Default time-to-live for cache entries in seconds
**kwargs: Additional arguments passed to the Redis client
**kwargs: Additional arguments passed to the Redis client. A `ttl` key sets
the default time-to-live for cache entries in seconds; it is read per
lookup by _get_ttl, not forwarded to the Redis client
Raises:
Exception: If similarity_threshold is not provided or required Redis