ReMe/reme/core
jinliyl dc8eab56a1
refactor(core): replace text truncation utilities with new marker system (#179)
* refactor(core): replace text truncation utilities with new marker system

- Remove old truncate_text_utils module and its exports
- Replace TRUNCATION_MARKER_START with _TRUNCATION_NOTICE_MARKER constant
- Update as_msg_stat.py to split content using new marker format
- Modify FileIO tool to use TRUNCATION_NOTICE_MARKER for continuation hints
- Change is_truncated function checks to use marker presence detection
- Move transformers dependency from main deps to light extra dependencies
- Update tool result compactor tests to verify marker instead of is_truncated calls

* feat(file_io): enhance file operations with path resolution and append functionality

- Add expanduser() to resolve file paths with ~ symbol
- Implement proper file existence and type validation in update_file
- Add new append_file method to append content to files
- Update truncation notice format for better readability
- Fix typo in error message from "provide" to "provided"
- Update transformers dependency in pyproject.toml
- Remove duplicate transformers dependency from light extras

* refactor(file_io): disable pylint too-many-return-statements warning

* perf(file_watcher): increase default polling delay and optimize watcher configuration

- Increased default poll_delay_ms from 1000ms to 2000ms to reduce CPU usage
- Removed force_polling parameter as it's no longer needed with updated polling strategy
- Simplified async watch configuration by removing conditional force_polling logic
- Reduced overall system resource consumption during file watching operations

* refactor(memory): update conversation log documentation in memory summary

- Changed "Raw conversation logs" to "Earlier conversation logs" for clarity
- Added warning note about potentially large dialog file sizes
- Improved formatting with additional line break for better readability
- Maintained existing compressed summary integration unchanged

* feat(memory): add long-term memory support to file-based memory system

- Initialize _long_term_memory attribute as empty string
- Add memories section to content when long-term memory exists
- Consolidate summary and memories into single user message
- Format memories with markdown header # Memories
- Maintain existing compressed summary functionality
- Join multiple content parts with double newlines
2026-03-26 12:10:24 +08:00
..
as_llm refactor(core): update registry registration syntax and improve code formatting 2026-03-06 01:57:29 +08:00
as_llm_formatter Dev/token (#159) 2026-03-17 11:07:31 +08:00
as_token_counter feat(core): update version and enhance configuration management (#164) 2026-03-18 15:16:10 +08:00
embedding style(memory): update message formatting and improve logging (#175) 2026-03-24 00:20:15 +08:00
enumeration refactor(core): replace memory stores with file stores and update architecture 2026-02-26 14:18:12 +08:00
file_store fix(file-store): handle embedding API errors gracefully with fallback mechanism (#173) 2026-03-20 17:55:18 +08:00
file_watcher refactor(core): replace text truncation utilities with new marker system (#179) 2026-03-26 12:10:24 +08:00
flow refactor(core): restructure application initialization and service context 2026-02-26 17:56:59 +08:00
llm feat(core): update version and enhance configuration management (#164) 2026-03-18 15:16:10 +08:00
op refactor(file_io): update file I/O operations and truncation logic (#177) 2026-03-25 20:21:37 +08:00
schema refactor(core): replace text truncation utilities with new marker system (#179) 2026-03-26 12:10:24 +08:00
service refactor(core): restructure application initialization and service context 2026-02-26 17:56:59 +08:00
token_counter refactor(core): restructure application initialization and service context 2026-02-26 17:56:59 +08:00
tools refactor(core): restructure application initialization and service context 2026-02-26 17:56:59 +08:00
utils refactor(core): replace text truncation utilities with new marker system (#179) 2026-03-26 12:10:24 +08:00
vector_store refactor(core): restructure application initialization and service context 2026-02-26 17:56:59 +08:00
__init__.py refactor(cli): using AgentScope components to reimplement the reme_cli logic (#153) 2026-03-12 11:23:36 +08:00
application.py refactor(file_io): update file I/O operations and truncation logic (#177) 2026-03-25 20:21:37 +08:00
base_dict.py refactor(core): replace memory stores with file stores and update architecture 2026-02-26 14:18:12 +08:00
prompt_handler.py refactor(core): restructure application initialization and service context 2026-02-26 17:56:59 +08:00
registry_factory.py refactor(cli): using AgentScope components to reimplement the reme_cli logic (#153) 2026-03-12 11:23:36 +08:00
runtime_context.py refactor(core): restructure application initialization and service context 2026-02-26 17:56:59 +08:00
service_context.py feat(core): update version and enhance configuration management (#164) 2026-03-18 15:16:10 +08:00