Classic298 ae01ef9c95 fix: skip image, media and font requests in the Playwright web loader (#29742) ... Fetching a page with many media files through the Playwright web loader was extremely slow or timed out, while raw Playwright loaded the same page in a couple of seconds. The loader routes every request the page makes through the backend HTTP client and downloads the full body before the browser sees any of it, and the browser cancelling a media request once it has enough never reaches that download. On a page with a few dozen audio players every file was pulled in full for a text extraction that never reads it. Image, media and font requests are now aborted in the interceptor before any fetch is made. None of them feed the text extraction. Measured on the page from the report with the default timeout on the same connection: | | requests fetched | bytes downloaded | elapsed | |---|---|---|---| | before | 151 | 55.0 MB | 10.1 s | | after | 45 | 3.9 MB | 2.6 s | Fixes #29741		2026-09-06 17:01:00 -05:00
..
loaders	refac	2026-09-06 16:48:30 -04:00
models	fix: repair two broken logging calls, one of which makes VECTOR_DB=opengauss unusable (#27838)	2026-08-10 22:19:41 -06:00
vector	refac	2026-09-06 17:13:32 -04:00
web	fix: skip image, media and font requests in the Playwright web loader (#29742)	2026-09-06 17:01:00 -05:00
external.py	refac	2026-07-27 01:59:17 -04:00
utils.py	refac	2026-09-06 16:48:30 -04:00