mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-14 23:21:35 +00:00
3ea7f98725
* fix(proxy): build redis usage cache from REDIS_* env when cache backend is not Redis Selecting a semantic (or any non-Redis-KV) response cache left redis_usage_cache unset, silently downgrading cross-pod rate limits, parallel-request limits, spend coordination, and the pod lock manager to per-pod in-memory state. Fall back to a standalone RedisCache built from REDIS_* environment variables, mirroring the existing use_redis_transaction_buffer escape hatch, which now shares the same helper. Resolves LIT-3861 * feat(proxy): configure the coordination redis independently of the response cache Adds general_settings.coordination_redis, an explicit block for the Redis the proxy uses for cross-pod rate limits, parallel-request limits, spend tracking, the pod lock manager, and shared health checks. Resolution order is the explicit block, then a plain-Redis response-cache backend, then the REDIS_* environment. Cluster and sentinel targets are supported, and a cluster target now builds a RedisClusterCache so cluster-aware consumers take the cluster path. Admins can configure it from the Caching page of the dashboard via /coordination_redis/settings, which reports which source is in effect, redacts credentials on read, and offers a connection test. Settings saved there are read back at startup so they take effect on restart. Also fixes redis client construction so an explicitly configured host outranks REDIS_URL in the environment. Previously the url branch stripped the caller's host and port, so an explicit block, or a connection test typed into the dashboard, silently targeted whatever REDIS_URL named * fix(ui): move coordination_redis_settings into renamed _components directory --------- Co-authored-by: Yucheng Zhu <yucheng@berri.ai> |
||
|---|---|---|
| .. | ||
| _health_check_test_config.yaml | ||
| adaptive_router_example.yaml | ||
| aliases_config.yaml | ||
| azure_config.yaml | ||
| bad_schema.prisma | ||
| code_interpreter_interception_config.yaml | ||
| custom_auth.py | ||
| custom_auth_basic.py | ||
| custom_callbacks.py | ||
| custom_callbacks1.py | ||
| custom_guardrail.py | ||
| custom_handler.py | ||
| disable_schema_update.yaml | ||
| enterprise_config.yaml | ||
| langfuse_config.yaml | ||
| load_balancer.yaml | ||
| multi_instance_simple_config.yaml | ||
| oai_misc_config.yaml | ||
| opentelemetry_config.yaml | ||
| otel_test_config.yaml | ||
| pass_through_config.yaml | ||
| pipeline_test_guardrails.py | ||
| reject_clientside_metadata_tags_config.yaml | ||
| simple_config.yaml | ||
| spend_tracking_config.yaml | ||
| store_model_db_config.yaml | ||
| test_pipeline_config.yaml | ||
| tool_permission_example.yaml | ||
| websearch_interception_config.yaml | ||