ReMe/tests
huangsen 37f0037e6b feat(parser): add mistletoe dependency and refactor markdown parsing
Add mistletoe as a project dependency for enhanced markdown parsing
capabilities. Refactor the LinkedFileParser to use a proper AST-based
approach with MdNode tree structure, replacing the previous flat token
processing method. The new implementation provides better handling of
markdown elements including tables, code fences, lists, and headings,
with improved chunking logic that maintains document structure in
generated content segments.

The changes include:
- Add mistletoe dependency to pyproject.toml
- Implement proper AST node representation with MdNode class
- Create recursive chunking algorithm with TOC preservation
- Add support for frontmatter extraction with FileFrontMatter schema
- Optimize leaf node splitting with proper boundary detection
- Include part numbering for split content pieces
2026-05-13 16:00:36 +08:00
..
inspect_md_parser.py feat(parser): add mistletoe dependency and refactor markdown parsing 2026-05-13 16:00:36 +08:00
test_file_edge.py feat(parser): implement AST-based markdown chunking with full document TOC 2026-05-13 14:32:00 +08:00
test_md_chunker.py feat(parser): add mistletoe dependency and refactor markdown parsing 2026-05-13 16:00:36 +08:00
test_reme2.py feat: add file parser support and search filtering (#214) 2026-04-21 16:44:46 +08:00