open-webui/backend
Claude 7b30714941
fix(stream): refresh seq TTL with stream TTL, tighten hot-path timeout
- seq key now gets EXPIRE on the same periodic cadence as the stream
  key, not just on the first INCR. Prevents INCR restarting at 1 on
  responses longer than RESUME_STREAM_TTL_SEC (1h), which would have
  corrupted replay ordering.
- Hot-path Redis timeout trimmed 200ms → 100ms. Halves worst-case
  stall under degraded Redis (now ~200ms max per frame if both INCR
  and append time out); healthy Redis (<1ms) is unaffected.

Not addressed: the fundamental 2-RTT-per-frame cost of separate INCR
and XADD. Collapsing them would require either a Lua script (cluster
hash-tag concerns) or switching to Redis stream IDs as the seq cursor
(invasive protocol change). Leaving the structure intact — if
profiling shows real stalls in prod, stream-ID-as-seq is the cleaner
follow-up.
2026-04-14 22:44:59 +00:00
..
data refac: mv backend files to /open_webui dir 2024-09-04 16:54:48 +02:00
open_webui fix(stream): refresh seq TTL with stream TTL, tighten hot-path timeout 2026-04-14 22:44:59 +00:00
.dockerignore fix: litellm config issue 2024-02-24 22:35:11 -08:00
.gitignore refac 2024-09-06 04:59:20 +02:00
dev.sh refac 2026-03-24 19:43:30 -05:00
requirements-min.txt refac 2026-04-13 23:40:09 -05:00
requirements.txt refac 2026-04-13 23:40:09 -05:00
start.sh refac 2026-03-24 19:43:30 -05:00
start_windows.bat refac 2026-03-24 19:43:30 -05:00