mirror of
https://github.com/agentscope-ai/ReMe.git
synced 2026-09-30 01:52:29 +00:00
bb354cc580
* feat(config): add comprehensive job definitions for vault operations - Add utility jobs like version, search, traverse, list, read, stat - Include file operations like move, delete, upload, download - Add daily workspace management jobs: daily_list, daily_resolve, daily_reindex - Update descriptions to reflect vault-based operations instead of working_dir - Add proper section headers and documentation for each job category refactor(steps): reorganize step modules and remove demo steps - Move steps into categorized packages: common, crud, frontmatter, daily, jobs - Remove demo steps (DemoEchoStep1, DemoEchoStep2, StreamDemoStep1, StreamDemoStep2) - Add new steps: InitStep for vault initialization, TraverseStep for graph traversal - Update __init__.py to auto-import all step modules - Organize imports by functionality (common, CRUD operations, frontmatter, daily) feat(vault): implement vault-centric file operations and configuration - Change default config to use vault_dir instead of working_dir - Add environment variable support for embedding configuration - Implement file watcher with lite backend for daily/digest directories - Update search step to use 'name' instead of 'title' from frontmatter - Create ResourceEntry schema for tracking uploaded assets docs(steps): add comprehensive documentation for all step categories - Document file-I/O split by blast radius (crud vs frontmatter packages) - Add detailed descriptions for each step category and functionality - Explain the purpose and usage patterns for different types of file operations - Provide clear parameter documentation for all new job configurations * fix(config): correct vault directory path and remove unused job configurations - Fix vault_dir from 'vaultd' to 'vault' in default configuration - Remove deprecated traverse and list job configurations - Remove unused tag tooling configurations - Remove background watch_file job configuration refactor(steps): remove unused jobs module import - Comment out jobs module import in steps/__init__.py - This removes unused synchronizer and digester step registrations refactor(tests): update import path and add pylint directive - Update ResourceEntry import from reme4.schema to reme4.schema.resource_meta - Add pylint disable directive for unused argument in test datetime mocks * efactor(steps): remove unused modules from __all__ - Remove "background" module from __all__ list - Remove "jobs" module from __all__ list - These modules were no longer being used in the steps package * feat(config): update vault directory structure and remove file watcher - Change vault_dir reference from ./vault to ./vault in CLI example - Add daily_dir, digest_dir, and resource_dir configuration options - Remove file_watcher component configuration as it's no longer needed - Update comment to reflect correct module name (reme4vault) refactor(steps): add background step and remove deprecated init step - Import and register background step module - Remove deprecated InitStep from common steps - Update __all__ export list to include background step refactor(reindex): improve reindex step to scan vault directly - Update docstring to reflect vault scanning instead of watcher sync - Replace file watcher stop/start logic with direct vault path walking - Add support for suffix filtering during reindex operation - Use index_changes job to process found files refactor(wikilink_utils): enhance inbound source lookup with link scope - Import LinkScopeEnum for proper type handling - Update get_inlinks call to use ALL scope for virtual targets - Improve documentation for reverse-index lookup behavior test(refactor): clean up test suite removing deprecated functionality - Remove test_init_job and test_demo_job unit tests - Update help job assertion to check for literal command format - Change test directory from .reme to vault in CRUD tests - Remove init and demo job calls from integration test BREAKING CHANGE: Removes file_watcher component and init step * style(steps): fix import formatting in __init__.py Add proper spacing in the background module import statement to maintain consistent code style and readability. * refactor(config): change default vault directory from vault to .reme Default dev config now points vault_dir at ./.reme so `python -m reme4 start` can be run from the repo root and exercise the full atomic-tool surface against the seeded test data. BREAKING CHANGE: The default vault directory has been changed from 'vault' to '.reme' in the configuration. * docs(reme4_report): fix markdown formatting and remove extra content * refactor(file_parser): delegate wikilink extraction to WikilinkHandler * fix(search): handle empty query case gracefully - Replace assertion with conditional check for empty query - Set response success to false when query is empty - Return error message instead of throwing assertion error - Maintain existing validation for other parameters
46 lines
2 KiB
Python
46 lines
2 KiB
Python
"""steps — registers every BaseStep subclass at import time.
|
|
|
|
Each submodule's ``@R.register`` decorators only fire when the module
|
|
is imported. Auto-importing them here means any config that names a
|
|
step backend (e.g. ``graph_traverse_step``, ``write``, ``digester``)
|
|
will find it in the registry without the caller having to remember
|
|
which submodule it lives in.
|
|
|
|
File-I/O is split by blast radius. The ``crud`` package covers both
|
|
opaque-byte ops (list / stat / move / delete / upload / download) and
|
|
whole-file text ops (read / write / append / edit) — they share the
|
|
same path-resolution helpers, so they live in one package.
|
|
``frontmatter`` is the one sliced surface that earns its own RUD
|
|
package (YAML is structured data — surgical key edits cannot be safely
|
|
emulated with string-substitution on the body). For mid-file body
|
|
edits, use ``edit`` (exact string replacement) or do a read + write
|
|
round-trip.
|
|
|
|
* ``common`` — search / health_check / help / reindex / version / graph_traverse
|
|
* ``crud`` — list / stat / move / delete / upload / download / read / write / append / edit
|
|
* ``frontmatter`` — markdown frontmatter slice RUD (frontmatter_read_step / update / delete)
|
|
* ``daily`` — note genesis / list / day-index reindex
|
|
* ``jobs`` — synchronizer / digester (LLM-driven orchestrators)
|
|
"""
|
|
|
|
from . import common # noqa: F401 -- registers common steps (search, version, graph_traverse, ...)
|
|
from . import crud # noqa: F401 -- registers list/stat/upload/download/move/delete/read/write/append/edit
|
|
from . import frontmatter # noqa: F401 -- registers frontmatter_read_step/update/delete
|
|
from . import (
|
|
daily,
|
|
) # noqa: F401 -- registers daily_resolve_step / daily_create_step / daily_list_step / daily_reindex_step
|
|
from . import background # noqa: F401
|
|
|
|
# from . import jobs # noqa: F401 -- registers synchronizer / digester
|
|
from .base_step import BaseStep
|
|
from . import graph # noqa: F401
|
|
|
|
__all__ = [
|
|
"background",
|
|
"common",
|
|
"crud",
|
|
"graph",
|
|
"frontmatter",
|
|
"daily",
|
|
"BaseStep",
|
|
]
|