scriptoriumadmin/open-webui
1
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-09-23 00:41:56 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3
open-webui/backend/open_webui/test
History
Álvaro Justen (@turicas) 28a4df7921 fix: honor requests_per_second in FireCrawl loader 
`SafeFireCrawlLoader` inherits `RateLimitMixin` and accepts
`requests_per_second` in its constructor, but neither `lazy_load` nor
`alazy_load` ever invoked `_sync_wait_for_rate_limit` /
`_wait_for_rate_limit`. The configured value (env
`WEB_LOADER_CONCURRENT_REQUESTS`) was silently ignored: the loader fired
requests as fast as the loop ran.

`_safe_process_url` is not used because it's redundant for FireCrawl:
FireCrawl fetches the target URL on the user's behalf, and `verify_ssl`
is already honored in the FireCrawl payload (`skipTlsVerification`).
2026-04-27 19:55:01 -03:00
..
apps/webui refac 2026-03-17 17:58:01 -05:00
util refac 2026-03-17 17:58:01 -05:00
__init__.py refac: mv backend files to /open_webui dir 2024-09-04 16:54:48 +02:00
test_retrieval_web_firecrawl_loader.py fix: honor requests_per_second in FireCrawl loader 2026-04-27 19:55:01 -03:00