huangsen 51ec09d98f feat(parser): implement AST-based markdown chunking with full document TOC ... - Replace legacy line-based chunking with AST tree approach that builds a complete document skeleton with content inlined under relevant sections - Add new chunking parameters: chunk_chars (default 2000) and embed_toc (default True) to control content size and TOC inclusion - Implement recursive chunking algorithm that respects structural boundaries (code lines, table rows, list items) and prevents splits inside blocks - Introduce part markers [Part X/N] for oversized leaf blocks that require splitting - Add CLI tool for inspecting parsed chunks and edges with options for preview and configuration - Refactor edge extraction to use FileEdge.from_text instead of parse_wikilinks for consistency BREAKING CHANGE: Chunk format changes significantly with full TOC skeleton wrapping content, affecting embedding models expecting breadcrumb prefixes.		2026-05-13 14:32:00 +08:00
..
test_file_edge.py	feat(parser): implement AST-based markdown chunking with full document TOC	2026-05-13 14:32:00 +08:00
test_md_chunker.py	feat(parser): implement AST-based markdown chunking with full document TOC	2026-05-13 14:32:00 +08:00
test_reme2.py	feat: add file parser support and search filtering (#214)	2026-04-21 16:44:46 +08:00