ReMe/reme2/component/file_parser
jinli.yl 3fc3fd65e8
Some checks failed
Pre-commit / run (ubuntu-latest) (push) Has been cancelled
feat(parser): add base file parser and concrete implementations
- Introduce BaseFileParser abstract class with component registration
- Add MdFileParser implementation for markdown files with YAML frontmatter
- Create TextFileParser implementation with built-in chunking support
- Implement file suffix enumeration for parser type safety
- Add chunking logic with configurable token size and overlap
- Support text file parsing with error handling for encoding issues
- Include line number tracking and content hashing for file chunks
2026-04-24 21:00:31 +08:00
..
__init__.py feat: add file parser support and search filtering (#214) 2026-04-21 16:44:46 +08:00
base_file_parser.py feat(parser): add base file parser and concrete implementations 2026-04-24 21:00:31 +08:00
md_file_parser.py feat(parser): add base file parser and concrete implementations 2026-04-24 21:00:31 +08:00
text_file_parser.py feat(parser): add base file parser and concrete implementations 2026-04-24 21:00:31 +08:00