mirror of
https://github.com/open-webui/open-webui.git
synced 2026-09-19 00:03:21 +00:00
9d3d80b9f8
When fetch_url fetches a PDF URL, the content was returned as garbled binary because BeautifulSoup's HTML parser corrupted the PDF bytes. Add three-layer PDF detection: - Fast-path for URLs ending in .pdf (case-insensitive) - Content-Type header detection in async SafeWebBaseLoader._fetch - %PDF binary content fallback in get_content_from_url Includes SSRF protection via validate_url(), streaming download with Content-Length pre-check, 50 MB size limit, and proper session management. No new dependencies (pypdf already in requirements.txt). Closes #23841 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| data | ||
| internal | ||
| migrations | ||
| models | ||
| retrieval | ||
| routers | ||
| socket | ||
| static | ||
| storage | ||
| test | ||
| tools | ||
| utils | ||
| __init__.py | ||
| alembic.ini | ||
| config.py | ||
| constants.py | ||
| env.py | ||
| functions.py | ||
| main.py | ||
| tasks.py | ||