Classic298 091c44c621 perf: stop rescanning the whole response for tag boundaries on every streamed chunk (#28861) ... Streamed responses are scanned for reasoning and code interpreter tags. To work out where the last complete tag ended, the scanner searched backwards from the start of the accumulated text on every chunk, once per tag set. Ordinary prose contains no angle bracket, so that search never stopped early and read the entire response back every time. The cost grows with the square of the response length, and this scanning is on unless a model turns it off. The two positions are now carried forward as the text grows, so each chunk only scans the characters it added. Measured on CPython 3.12, a 270 KB response streamed in 27000 chunks: | response text | before | after | |---|---|---| | no newlines | 7690 ms | 40.6 ms | | with newlines | 5695 ms | 41.7 ms | The carried positions match a full rescan at every step of 36282 randomized replays, covering text with no markers, newlines only, dense markers, real tags and truncation part way through.		2026-08-24 05:11:32 -05:00
..
access_control	perf: resolve group membership once per folder listing instead of once per entry (#28810)	2026-08-19 11:16:29 -07:00
images	perf: build debug log messages lazily so disabled debug logs cost nothing (#27834)	2026-07-31 19:09:01 -05:00
mcp	refac	2026-06-29 11:56:00 -05:00
telemetry	refac(telemetry): drop deprecated semconv SpanAttributes subclass (#25784)	2026-06-29 02:05:34 -05:00
actions.py	fix: enforce action availability and model access on the chat action route (#27243)	2026-07-23 12:23:05 -04:00
anthropic.py	refac	2026-07-31 17:41:14 -04:00
asgi_middleware.py	fix: report sub-second timings in the X-Process-Time header (#27368)	2026-07-23 18:09:23 -05:00
ask_user.py	refac	2026-08-13 21:02:17 -06:00
audit.py	perf: build debug log messages lazily so disabled debug logs cost nothing (#27834)	2026-07-31 19:09:01 -05:00
auth.py	fix: revoke existing sessions when a password changes (#28725)	2026-08-17 13:56:29 -07:00
automations.py	refac	2026-08-13 16:42:10 -06:00
calendar.py	refac	2026-07-31 17:30:47 -04:00
channels.py	refac	2026-03-17 17:58:01 -05:00
chat.py	perf: build info log messages lazily so raising the log level actually saves work (#27837)	2026-08-02 15:39:10 -05:00
chat_fork.py	refac	2026-07-23 02:54:56 -04:00
chat_id.py	refac	2026-07-26 21:12:14 -04:00
chat_variables.py	refac	2026-07-31 17:41:14 -04:00
code_interpreter.py	refac	2026-07-31 17:41:14 -04:00
context_compaction.py	refac	2026-08-23 13:36:53 -04:00
embeddings.py	refac: modernize type annotations (PEP 604 / PEP 585)	2026-05-12 17:10:15 +09:00
files.py	refac	2026-07-23 21:29:33 -04:00
filter.py	perf: build debug log messages lazily so disabled debug logs cost nothing (#27834)	2026-07-31 19:09:01 -05:00
groups.py	refac: modernize type annotations (PEP 604 / PEP 585)	2026-05-12 17:10:15 +09:00
headers.py	chore: format	2026-07-27 00:12:47 -04:00
json_codec.py	perf: write task payloads to Redis as bytes (#28833)	2026-08-20 12:58:52 -07:00
json_response.py	perf: optional orjson JSON codec behind ENABLE_ORJSON (#27583)	2026-07-27 03:45:37 -04:00
logger.py	perf: stop formatting every exported log record twice under OTEL log export (#27840)	2026-08-10 23:13:52 -06:00
memory.py	refac	2026-08-10 19:28:21 -06:00
middleware.py	perf: stop rescanning the whole response for tag boundaries on every streamed chunk (#28861)	2026-08-24 05:11:32 -05:00
misc.py	refac	2026-08-23 02:34:08 -04:00
model_ids.py	refac	2026-07-26 23:09:22 -04:00
models.py	refac	2026-08-13 00:07:31 -06:00
notifications.py	refac	2026-07-27 19:39:36 -04:00
oauth.py	fix: revoke existing sessions when a password changes (#28725)	2026-08-17 13:56:29 -07:00
payload.py	refac	2026-08-16 22:56:19 -07:00
pdf_generator.py	refac: modernize type annotations (PEP 604 / PEP 585)	2026-05-12 17:10:15 +09:00
plugin.py	perf: build info log messages lazily so raising the log level actually saves work (#27837)	2026-08-02 15:39:10 -05:00
rate_limit.py	refac: modernize type annotations (PEP 604 / PEP 585)	2026-05-12 17:10:15 +09:00
redis.py	fix: Set default Redis socket timeout to None (#27104)	2026-07-27 00:30:00 -04:00
response.py	refac	2026-08-17 00:57:57 -07:00
sanitize.py	refac	2026-03-17 17:58:01 -05:00
security_headers.py	perf: stop recomputing static work in per-response ASGI middlewares (#27229)	2026-07-23 12:29:01 -04:00
session_pool.py	refac	2026-07-27 04:17:00 -04:00
subagents.py	refac	2026-08-10 20:13:03 -06:00
task.py	refac	2026-06-19 00:16:06 +02:00
terminals.py	refac	2026-08-19 22:48:32 -07:00
timers.py	fix: index the chat queries that make large SQLite instances unusable (#27663)	2026-08-23 16:11:54 -05:00
tool_approval.py	refac	2026-08-16 22:52:24 -07:00
tools.py	refac	2026-08-23 15:14:43 -04:00
validate.py	refac	2026-07-27 19:39:36 -04:00
valves.py	refac	2026-07-31 17:41:14 -04:00
webhook.py	perf: build debug log messages lazily so disabled debug logs cost nothing (#27834)	2026-07-31 19:09:01 -05:00