ReMe/reme4/schema
jinliyl 2c35d31762
feat(application): add thread pool support and background job threading capabilities (#270)
* feat(application): add thread pool support and background job threading capabilities

- Integrate ThreadPoolExecutor for shared thread pool management in application context
- Add thread_pool_max_workers configuration option with default value of 0 (disabled)
- Implement thread pool creation and shutdown in application lifecycle methods
- Add use_thread_pool option to background job configuration for thread-based execution
- Support both asyncio event loop and threading event for background job stop mechanism
- Implement _run_in_thread method for running supervisors in dedicated threads
- Modify embedding models to use serial batching instead of concurrent batching
- Remove max_concurrency parameter from base embedding model component
- Update embedding model documentation to reflect serial batching implementation
- Add pyproject.toml with project metadata, dependencies, and build configuration

* refactor(job): simplify background job thread execution

- Replace separate _run_in_thread method with direct lambda execution
- Remove unnecessary ensure_future wrapper for thread pool execution
- Simplify asyncio event loop usage in thread pool mode
- Maintain same background job functionality with cleaner implementation
- Remove redundant method definition and streamline execution flow
2026-06-02 16:58:53 +08:00
..
__init__.py dev/reme4 init merge (#236) 2026-05-17 14:14:43 +08:00
application_config.py feat(application): add thread pool support and background job threading capabilities (#270) 2026-06-02 16:58:53 +08:00
emb_node.py dev/reme4 init merge (#236) 2026-05-17 14:14:43 +08:00
file_chunk.py feat: rename working_dir to vault_dir and update documentation (#254) 2026-05-22 18:10:29 +08:00
file_front_matter.py feat: rename working_dir to vault_dir and update documentation (#254) 2026-05-22 18:10:29 +08:00
file_link.py dev/reme4 init merge (#236) 2026-05-17 14:14:43 +08:00
file_node.py feat: rename working_dir to vault_dir and update documentation (#254) 2026-05-22 18:10:29 +08:00
request.py feat: rename working_dir to vault_dir and update documentation (#254) 2026-05-22 18:10:29 +08:00
response.py dev/reme4 init merge (#236) 2026-05-17 14:14:43 +08:00
stream_chunk.py dev/reme4 init merge (#236) 2026-05-17 14:14:43 +08:00