Commit graph

57 commits

Author SHA1 Message Date
jinli.yl
594495de9e feat(memory): add is_summarized flag to track tool call summarization
- Add is_summarized boolean field to ToolCallResult schema
- Implement logic to mark tool calls as summarized after processing
- Skip summarization for tools with all recent calls already summarized
- Update summary operation to process only tools with unsummarized calls
- Enhance logging to show summarization and skip statistics
- Modify response to include count of summarized vs skipped tools
- Add documentation for smart skip logic and is_summarized feature
- Include test scenarios for skip logic and incremental summarization
2025-10-22 11:19:43 +08:00
jinli.yl
49819a8e54 feat(tool): implement tool memory management and mock search tools- Added RetrieveToolMemoryOp for retrieving tool memory guidelines- Implemented LLM-based mock search tools with configurable complexity levels
- Enhanced tool call result parsing with improved scoring logic (0.0 or 1.0)
- Updated tool memory schema to reflect binary success/failure scoring
- Added deterministic behavior support via seed configuration in mock tools
- Improved evaluation prompts to focus on result quality over success flags
- Extended README with tool memory documentation and usage examples- Added utility functions for generating mock tool call results
- Removed deprecated test file for UseMockSearchOp- Updated default configurations to include use_mock_search operation- Bumped version to0.1.10 and updated flowllm dependency requirement
- Moved deprecation warnings to main init file
- Simplified tool memory summary formatting by removing redundant statistics
- Fixed tool call result processing to handle multiple tool names concurrently
2025-10-21 21:03:14 +08:00
jinli.yl
12f0b7d124 feat(agent): implement mock search tools and tool memory benchmark
- Added LLMMockSearchOp for simulating search operations with configurable complexity- Created SearchToolA, SearchToolB, and SearchToolC with distinct performance profiles- Implemented UseMockSearchOp for intelligent tool selection based on query analysis
- Added test scripts and query datasets for evaluating tool memory effectiveness
- Integrated tool memory service for storing and retrieving tool performance data
- Created documentation for tool memory benchmark testing methodology
- Refactored agent module structure and imports
- Increased summary tool memory recent call count from20 to 30
2025-10-16 23:31:50 +08:00
jinli.yl
b07213791f feat(tool): implement tool memory management and summarization
- Added SummaryToolMemoryOp for analyzing tool usage patterns- Implemented RetrieveToolMemoryOp for fetching tool memories
- Enhanced ParseToolCallResultOp with evaluation and scoring logic
- Updated ToolMemory schema with summary, evaluation, and score fields
- Added new prompt templates for tool evaluation and summarization
- Configured tool memory operations in default.yaml
- Fixed success flag logic in ToolCallResult processing
- Improved statistical analysis for tool call history
- Added concurrent processing for tool call evaluations
- Integrated tool memory updates with vector store operations
2025-10-16 15:49:49 +08:00
jinli.yl
b9da8d2a7f feat(memory): add tool call result handling and memory management
- Add new ToolCallResult and ToolMemory schemas for tracking tool executions
- Implement tool memory retrieval and summarization flows in default config
- Register new parse_tool_call_result_op for processing tool call results
- Extend memory conversion logic to support tool memory type
- Add test cases for tool memory serialization and deserialization
- Include token counting utilities for text processing tasks
2025-10-16 10:50:27 +08:00
jinli.yl
b9e2fdd4b0 refactor(reme_ai): remove unnecessary environment variable check
- Remove the assertion for FLOW_APP_NAME environment variable
- This change simplifies the __init__.py file and removes a potential  source of runtime errors due to missing environment variables
2025-09-16 17:22:25 +08:00
jinli.yl
1a549de552 refactor(reme_ai): move FLOW_APP_NAME check to __init__.py
- Move the FLOW_APP_NAME environment variable check from app.py to __init__.py
- This change ensures that the environment variable is checked as soon as the package is imported
- Removed redundant import of os in app.py since it's no longer needed there
2025-09-16 17:09:09 +08:00
jinli.yl
3d430c2d24 fix(app): update flowllm dependency and add environment variable check
- Update flowllm dependency to version 0.1.9
- Add environment variable check for FLOW_APP_NAME
2025-09-16 17:01:17 +08:00
jinliyl
560e746cea
reformat code, support flowllm 0.1.9 (#26)
* reformat code, support flowllm 0.1.9

* Update README.md

add FLOW_USE_FRAMEWORK=true

* Update README_ZH.md

add FLOW_USE_FRAMEWORK=true

* Update index.md

add FLOW_USE_FRAMEWORK=true

* add env FLOW_APP_NAME=ReMe
2025-09-16 16:49:56 +08:00
jinli.yl
fed4ad40d8 docs(service): update service description layout and content
- Simplified table structure for better readability
- Adjusted column widths for a more balanced layout
- Moved GitHub link and environment variable information to the Note column
- Improved consistency in language and formatting across both service descriptions
2025-09-09 14:15:59 +08:00
jinli.yl
a1fb20998b docs(service): update service description layout and content
- Adjust column widths for better readability
- Capitalize table header text
- Replace 'Desc' with 'Description' for clarity
- Make 'Note' column more concise and include GitHub link
- Update environment variable information formatting
2025-09-09 12:30:40 +08:00
jinli.yl
4834b53f22 docs(service): update service description layout- Replace markdown table with HTML table for better formatting
- Adjust column widths for improved readability
- Wrap import statements and environment variables in <code> tags
- Update links to point to the correct GitHub repository
2025-09-09 12:24:46 +08:00
jinli.yl
564df4e9e5 build: bump version to 0.1.8 and update dependencies
- Update package version from 0.1.7 to 0.1.8
- Upgrade minimum Python version to 3.12
- Update flowllm dependency to version 0.1.8
2025-09-08 16:30:03 +08:00
jinli.yl
8d407b4ed9 refactor(config): update data types in default.yaml and upgrade flowllm dependency
- Change 'str' to 'string' for consistency in data types
- Rename 'list' to 'array' for JSON compatibility
- Update 'bool' to 'boolean' and 'int' to 'integer' for standardization
- Upgrade flowllm dependency from >=0.1.6 to >=0.1.7
2025-09-08 15:55:25 +08:00
jinli.yl
074bc6dbac docs(service): update service description and add GitHub link
- Update service description for ReMe.PersonalMemoryService and ReMe.TaskMemoryService
- Add GitHub link for further information
- Clarify environment variables needed for configuration
2025-09-08 12:28:10 +08:00
jinli.yl
0ca73bf85d docs(service): add service description for PersonalMemoryService and TaskMemoryService
- Create service_description.md file to document ReMe services
- Add descriptions for PersonalMemoryService and TaskMemoryService
- Include import statements and environment variable requirements- Highlight key features and use cases for each service
2025-09-08 12:26:10 +08:00
jinli.yl
ca5ccb1d53 chore: ignore deprecation warnings for websockets and uvicorn
- Filter out deprecation warnings for websockets and uvicorn modules
- Add import for warnings module
2025-09-08 00:05:36 +08:00
jinli.yl
f93ae5c3e5 refactor(memory): update message handling and bump version
- Update message variable from 'messages' to 'new_messages' in memory services
- Bump package version from 0.1.6 to 0.1.7
- Update FlowLLM dependency version from >=0.1.5 to >=0.1.6
2025-09-07 18:26:10 +08:00
jinli.yl
2b3724b69b build: bump version to 0.1.6
- Update version in __init__.py and pyproject.toml
2025-09-07 16:08:32 +08:00
jinli.yl
a9f061b92d refactor(vector_store): update search functionality and documentation
- Remove deprecated `add_dict_filter` method from vector store operations
- Update `async_search` method to use `filter_dict` parameter for advanced filtering
- Modify examples in documentation to use the new `filter_dict` format for advanced filtering
- Update task memory and messages for consistency with new filtering approach
2025-09-07 15:58:31 +08:00
jinli.yl
948cddf423 feat(service): implement base memory service and personal/task memory services
- Add BaseMemoryService abstract class with common memory operations
- Implement PersonalMemoryService and TaskMemoryService concrete classes
- Update default config to use async services for memory operations
- Modify recall and retrieve ops to use context for top_k parameter
- Update vector store action op to handle list action and return result directly
2025-09-07 14:15:36 +08:00
jinli.yl
4a00f51c3c refactor(demo): update personal memory demo and remove unused files
- Update personal memory demo to use new memory format
- Remove unused task memory and message files
- Adjust vector store configuration in default.yaml
- Modify load_today_memory_op to use new search method
2025-09-07 00:03:49 +08:00
jinli.yl
bf3fa875aa refactor(vector_store): update memory operations to use async search
- Update load_today_memory_op.py to use async version of _retrieve_today_memories
- Update memory_deduplication_op.py to use async version of _deduplicate_task_memories and _get_existing_task_memory_embeddings
- Update retrieve_memory_op.py to use async_search instead of search
2025-09-06 21:42:55 +08:00
jinli.yl
a9188edeb2 refactor(vector_store): update vector store ops to use async methods
- Rename execute() to async_execute() in multiple vector store operation classes
- Update method calls to use async versions (e.g., async_search, async_delete)
- This change allows for asynchronous execution of vector store operations
2025-09-06 21:33:14 +08:00
jinli.yl
6bb3ab90fc refactor(llm): update LLM-related ops to use async execution
- Modify LLM-related ops to use async_execute instead of execute
- Replace chat method with achat for asynchronous LLM calls
- Update method signatures and return types to support async operations
- This change affects multiple files across the project
2025-09-06 20:27:25 +08:00
jinli.yl
49c73b15b3 refactor(reme_ai): update app and ops for async execution and new LLM features
- Update app.py to use async service initialization
- Refactor multiple ops to use async_execute instead of execute
- Add support for stream and use_async flags in config
- Update LLM usage to use achat instead of chat
- Add new LLM models and update existing ones in config
- Improve error handling and logging in several ops
- Update dependencies and Python version requirements
2025-09-06 20:17:33 +08:00
jinli.yl
cd37020ff5 refactor(README): update documentation and remove unused code
- Remove unused import in reme_ai/summary/task/__init__.py
- Remove unused constant in reme_ai/constants/common_constants.py
- Update README.md with new content and structure
- Update README_ZH.md with minor corrections
- Modify task memory documentation for clarity
2025-09-02 21:39:04 +08:00
jinli.yl
e8ca114e59 refactor(reme_ai): remove unused PDF processing components
- Remove MinerUPDFProcessor and related classes
- Delete pdf_preprocess_op_wrapper.py
- Update task_summary_ops.md to remove PDFPreprocessOp documentation
- Add LLM-related keywords to pyproject.toml
2025-09-02 20:52:14 +08:00
jinli.yl
a4d8e5912d docs(README): update ReMe results table and remove unused code
- Update the ReMe results table in README_ZH.md for better readability
- Remove unused and outdated code in trajectory_preprocess_op.py
2025-09-02 19:10:08 +08:00
zouyingcao
e87d4166a3 Merge branch 'merge' of https://github.com/modelscope/MemoryScope into merge 2025-09-02 16:54:30 +08:00
zouyingcao
c6bc749ab5 add: customize op in config 2025-09-02 16:54:27 +08:00
jinli.yl
803c53fba1 docs(README): add comprehensive documentation for ReMe.ai framework
- Added detailed information about the project's architecture, installation, and usage
- Included sections on task memory and personal memory management
- Provided examples and use cases for the framework
- Updated project metadata and version information
2025-09-02 10:51:41 +08:00
jinli.yl
80dae9953e refactor(memory): update personal memory flows and adjust related components
- Move retrieve_personal_memory and summary_personal_memory flows to new positions in default.yaml
- Update info_filter_op to handle trajectories instead of messages
- Adjust use_personal_memory_demo to use trajectories in API requests
2025-09-01 14:19:38 +08:00
jinli.yl
2fdb51ff5e refactor(trajectory): add missing import for json module
- Added 'import json' at the beginning of trajectory_preprocess_op.py
- This import is necessary for handling JSON data in the trajectory preprocessing task
2025-08-31 16:04:20 +08:00
jinli.yl
0c2fb9a522 refactor(reme_ai): formatting and minor code improvements
- Removed unnecessary comments
- Improved code formatting across multiple files
- Updated import statements and removed unused imports
- Refactored some function definitions for better readability
2025-08-31 15:58:59 +08:00
zouyingcao
72db149964 Merge branch 'merge' of https://github.com/modelscope/MemoryScope into merge 2025-08-29 16:37:14 +08:00
zouyingcao
fa6d847a0c fix bug[trajectory_preprocess_op]: parsing the tool_calls in correct format 2025-08-29 16:36:57 +08:00
jinli.yl
e26338fb95 feat(react): add simple react operator and update related functionalities
- Add SimpleReactOp to react module
- Update reme_ai/__init__.py to include react module
- Modify contra_repeat_op.py to use memory_id instead of id
- Adjust datetime_handler.py to handle string datetime conversion
- Update default.yaml to include react flow content
- Modify get_observation_op.py and get_observation_with_time_op.py to use workspace_id from context
- Update test/http_client_test.py to test new react functionality
- Adjust messages.jsonl to reflect new analysis approach for Xiaomi Corporation
2025-08-29 14:40:30 +08:00
jinli.yl
adce394cd0 feat(react): add simple react operator and update related functionalities
- Add SimpleReactOp to react module
- Update reme_ai/__init__.py to include react module
- Modify contra_repeat_op.py to use memory_id instead of id
- Adjust datetime_handler.py to handle string datetime conversion
- Update default.yaml to include react flow content
- Modify get_observation_op.py and get_observation_with_time_op.py to use workspace_id from context
- Update test/http_client_test.py to test new react functionality
- Adjust messages.jsonl to reflect new analysis approach for Xiaomi Corporation
2025-08-29 11:56:50 +08:00
caozouying.czy
7c639184cb add: add new op for ReMe service 2025-08-29 01:04:06 +08:00
caozouying.czy
61a83892bd update: merge the config.yaml 2025-08-28 14:44:06 +08:00
caozouying.czy
6decf51793 remove the change in vector_store_action_op 2025-08-28 14:33:38 +08:00
jinli.yl
074634d884 refactor(reme_ai): consolidate personal memory and update related ops
- Rename and restructure personal memory consolidation flow
- Update memory handling in context and operations
- Refactor memory schema to use time_created and time_modified fields
- Improve error handling and logging in memory operations
- Update test cases for new memory consolidation flow
2025-08-28 14:31:03 +08:00
jinli.yl
527e04140c refactor(personal): standardize memory operations and improve time handling
- Rename and restructure memory loading operations
- Enhance time extraction and formatting capabilities- Implement more robust memory filtering and ranking logic
- Refactor observation extraction methods for better reusability
- Improve logging and error handling in memory operations
2025-08-28 01:24:34 +08:00
caozouying.czy
8dba31f2b2 update: combine the default.yaml 2025-08-27 18:41:46 +08:00
caozouying.czy
917a1a4725 add: add op about memory management 2025-08-27 18:35:53 +08:00
jinli.yl
8600015632 refactor(reme_ai): rename and restructure modules for better organization
- Rename `worker` to `op` for operation classes
- Remove `memoryscope` package
- Create `constants` package with common constants
- Update module imports and class names accordingly
2025-08-27 17:05:40 +08:00
jinli.yl
9fb7aa4e78 feat(agent): add agent module and update related components
- Add agent module to reme_ai package
- Update retrieve module to include agent-related functionality
- Modify summary module to use new agent features
- Update configuration to support agent operations
2025-08-27 11:37:14 +08:00
jinli.yl
423cf2f262 refactor(import): update import statements and rename classes across multiple modules
- Update import statements to use relative imports where appropriate
- Rename classes to match file names for better consistency
- Add new imports for recently added modules
2025-08-27 11:07:02 +08:00
jinli.yl
3e6bd05f60 feat(vector_store): update vector store action operator
- Modify input schema to use 'action' instead of 'query'- Update action enum to include specific vector store operations
- Change freq_threshold type from float to int
- Remove unnecessary agent configuration from default.yaml
2025-08-27 10:42:00 +08:00