open-webui/backend/open_webui/retrieval/loaders
Classic298 c3fbf36384
fix: uploaded files lose Chinese punctuation and quotes (#31655)
Text extracted from any uploaded file had full-width punctuation like :(),!? turned into ASCII :(),!? and curly quotes like “ ” turned into straight quotes, so both the file preview and the model saw altered text. Extracted text now keeps these characters as written, while garbled text from wrong encodings (like café becoming café) is still repaired. Files uploaded before this change keep the altered text until they are uploaded again.

Fixes #17087
2026-10-01 07:22:08 +04:00
..
datalab_marker.py refactor: remove the unreachable async half of the Mistral loader and an unused Datalab helper (#28839) 2026-08-20 13:14:14 -07:00
external_document.py feat: add {{USER_GROUPS}} and {{USER_GROUP_IDS}} placeholders for custom forwarded headers (#27236) 2026-07-26 23:21:26 -04:00
external_web.py refac 2026-07-27 19:39:36 -04:00
local.py refac 2026-09-12 20:09:21 -04:00
main.py fix: uploaded files lose Chinese punctuation and quotes (#31655) 2026-10-01 07:22:08 +04:00
microsoft_web_iq.py refac 2026-08-25 15:47:55 -04:00
mineru.py perf: build info log messages lazily so raising the log level actually saves work (#27837) 2026-08-02 15:39:10 -05:00
mistral.py refactor: remove the unreachable async half of the Mistral loader and an unused Datalab helper (#28839) 2026-08-20 13:14:14 -07:00
paddleocr_vl.py perf: build info log messages lazily so raising the log level actually saves work (#27837) 2026-08-02 15:39:10 -05:00
pdf.py refac 2026-09-12 20:09:21 -04:00
tavily.py refac 2026-08-24 17:56:11 -04:00
youtube.py fix(retrieval): report why a URL could not be read instead of blaming the knowledge base (#28362) 2026-08-10 19:18:04 -06:00