mirror of
https://github.com/agentscope-ai/ReMe.git
synced 2026-08-28 05:25:04 +00:00
Some checks are pending
Pre-commit / run (ubuntu-latest) (push) Waiting to run
Tests ReMe / Unit Tests - py3.11 (push) Waiting to run
Tests ReMe / Unit Tests - py3.12 (push) Waiting to run
Tests ReMe / Unit Tests - py3.13 (push) Waiting to run
Windows Smoke / CLI smoke - py3.11 (push) Waiting to run
* feat(config): add environment variable configuration for agent subprocesses - Add environment field to ApplicationConfig to store variables for agent subprocesses - Remove dynamic loading of .env files in agent wrappers - Introduce subprocess_environment property in base agent wrapper - Pass application-level environment variables to Claude Code and Codex agents - Load environment variables once at startup and pass to ReMe application - Remove dependency on load_env utility in agent wrapper implementations - Update tests to use configured environment instead of dynamic loading - Remove unused environment loading utilities and related test cases * refactor(mcp): remove channel notification system and related components - Removed channel notification step implementation - Removed claim channel step implementation - Removed ChannelSink class from MCP service - Removed channel-related documentation from AGENTS.md - Removed channel instruction text from MCP service - Removed all channel-related tests - Updated application context metadata comment to remove channel sink reference - Removed channel module initialization and imports * feat(service): add job whitelisting capability to BaseService - Add optional jobs parameter to BaseService.__init__ to configure job whitelist - Store jobs as set in self.jobs attribute for efficient lookup operations - Modify add_jobs method to filter jobs based on whitelist configuration - Update documentation in both English and Chinese to describe new feature - Add comprehensive unit tests for job whitelisting behavior - Implement flowchart update showing new filtering logic - Preserve existing enable_serve flag behavior alongside new whitelisting * refactor(service): enhance service job validation and MCP tool injection - Add strict validation for service jobs whitelist with detailed error messages - Implement injected job arguments support for MCP services with conflict detection - Add tool error handling for unsuccessful responses in MCP services - Remove duplicate job names in Codex agent wrapper using dict.fromkeys - Update MCP server argument format from single JSON array to repeated --job flags - Add comprehensive test coverage for job injection and error handling scenarios - Update documentation to reflect service job validation and MCP features - Ensure application cleanup occurs even when service lifespan encounters errors * feat(agent): update skill handling to preserve existing Claude skills - Change skills parameter processing to use 'all' instead of filtered list - Add logic to select project skills without restricting Claude's existing skills - Update variable naming from 'skills' to 'selected_skills' for clarity - Modify application context metadata documentation to clarify in-memory state usage - Add test case to verify configured skills are added without filtering existing skills - Update internal skill directory handling to use renamed variable consistently * refactor(agent): restructure agent wrapper components and session storage - Move CcFileSessionStore to separate module for better organization - Add SDK package version logging in base agent wrapper - Update Claude Code agent to use new session store structure with project keys - Refactor Claude Code agent wrapper to use proper type hints and SDK integration - Add support for server tool use events in Claude Code message processing - Improve error handling and resource cleanup in streaming operations - Update Codex agent wrapper with proper type annotations and configuration - Remove deprecated system prompt mode handling from Claude Code wrapper - Fix session path construction for Claude Code transcript storage - Update dependency injection and configuration handling patterns * fix(cc_agent_wrapper): resolve Claude Code SDK integration issues - Added dataclass import and created _BlockState for content block metadata tracking - Implemented proper MCP server name constant and tool context ID validation - Fixed tool_context_id injection to prevent duplicate assignment errors - Resolved skills parameter handling in build_options method - Enhanced job tools integration with MCP servers mapping validation - Replaced deprecated block_ids/block_types/tool_call_names with block_states dict - Updated message_delta to emit USAGE chunks instead of REPLY_END - Fixed stream result handling to ensure proper REPLY_END emission - Improved error handling for session mirror failures and rate limits - Added proper cleanup for expected trailing errors in streams - Refactored Codex agent wrapper initialization and configuration management - Removed obsolete system_prompt_mode from default config - Enhanced test coverage for new block state and error handling features - Fixed async generator handling with aclosing context manager - Improved chunk type mapping for Claude Code SDK events * refactor(tests): remove demo config tests from config parser test suite - Removed test_demo_config_registers_llm_jobs function and its assertions - Eliminated verification of LLM demo job configurations - Removed checks for agent wrapper component settings - Deleted assertions for model configurations and parameters - Cleaned up deprecated test cases related to demo config parsing * refactor(evolve): simplify Claude Code session store path structure - Removed redundant project key subdirectory from session link generation - Updated CcFileSessionStore initialization to use direct session directory path - Maintained existing session layout compatibility for backward compatibility - Added unit tests to verify session persistence behavior with existing transcripts - Ensured UUID-based session files remain accessible at expected locations - Preserved existing session directory structure without additional nesting * refactor(agent): defer optional Codex SDK imports until first use - Moved openai-codex imports inside functions to avoid mandatory dependencies - Added TYPE_CHECKING guard for development time type checking only - Implemented lazy loading mechanism with _get_async_codex_class function - Updated AsyncCodex initialization to occur on demand rather than at module level - Maintained backward compatibility while improving import performance - Added test case to verify package import works without optional Codex SDK - Updated agentscope dependency to version 2.0.4.post1 in pyproject.toml * test(embedded): add compatibility tests for in-process ReMe embedding - Add test suite for QwenPaw-style embedded configurations - Verify optional defaults remain preserved in embedded configs - Ensure in-process application API stays compatible - Test model injection and lifecycle management compatibility - Remove obsolete hermes agent plugin tests - Update CLI import test to cover multiple optional SDKs - Block claude_agent_sdk and openai_codex during import testing
110 lines
4.2 KiB
Python
110 lines
4.2 KiB
Python
"""File-backed session store for the Claude Agent SDK."""
|
|
|
|
import json
|
|
import shutil
|
|
from pathlib import Path
|
|
from typing import TYPE_CHECKING
|
|
|
|
if TYPE_CHECKING:
|
|
from claude_agent_sdk import SessionKey, SessionListSubkeysKey, SessionStoreEntry, SessionStoreListEntry
|
|
|
|
|
|
class CcFileSessionStore:
|
|
"""Persist SDK session entries as JSONL under ``project_key/session_id``."""
|
|
|
|
def __init__(self, root: Path) -> None:
|
|
self.root = root
|
|
|
|
@staticmethod
|
|
def _safe_parts(value: str) -> list[str]:
|
|
parts = [part for part in value.split("/") if part]
|
|
if not parts or any(part in {".", ".."} for part in parts):
|
|
raise ValueError(f"Invalid session store path component: {value!r}")
|
|
return parts
|
|
|
|
def _path(self, *values: str) -> Path:
|
|
path = self.root.joinpath(*(part for value in values for part in self._safe_parts(value)))
|
|
resolved_root = self.root.resolve()
|
|
resolved_path = path.resolve()
|
|
if resolved_root != resolved_path and resolved_root not in resolved_path.parents:
|
|
raise ValueError(f"Session store path escapes root: {resolved_path}")
|
|
return path
|
|
|
|
def _project_dir(self, project_key: str) -> Path:
|
|
return self._path(project_key)
|
|
|
|
def _path_for_key(self, key: "SessionKey") -> Path:
|
|
values = [key["project_key"], key["session_id"]]
|
|
if subpath := key.get("subpath"):
|
|
values.append(subpath)
|
|
return self._path(*values).with_suffix(".jsonl")
|
|
|
|
@staticmethod
|
|
def _read_entries(path: Path) -> list["SessionStoreEntry"]:
|
|
entries = []
|
|
for line in path.read_text(encoding="utf-8").splitlines():
|
|
if line.strip():
|
|
entries.append(json.loads(line))
|
|
return entries
|
|
|
|
async def append(self, key: "SessionKey", entries: list["SessionStoreEntry"]) -> None:
|
|
"""Append entries while treating their UUIDs as idempotency keys."""
|
|
if not entries:
|
|
return
|
|
|
|
path = self._path_for_key(key)
|
|
existing = self._read_entries(path) if path.exists() else []
|
|
seen = {entry.get("uuid") for entry in existing if entry.get("uuid")}
|
|
new_entries = []
|
|
for entry in entries:
|
|
uuid = entry.get("uuid")
|
|
if uuid and uuid in seen:
|
|
continue
|
|
if uuid:
|
|
seen.add(uuid)
|
|
new_entries.append(entry)
|
|
if not new_entries:
|
|
return
|
|
|
|
path.parent.mkdir(parents=True, exist_ok=True)
|
|
with path.open("a", encoding="utf-8") as file:
|
|
for entry in new_entries:
|
|
file.write(json.dumps(entry, ensure_ascii=False, separators=(",", ":")) + "\n")
|
|
|
|
async def load(self, key: "SessionKey") -> list["SessionStoreEntry"] | None:
|
|
"""Load all entries for a session or subkey."""
|
|
path = self._path_for_key(key)
|
|
return self._read_entries(path) if path.exists() else None
|
|
|
|
async def list_sessions(self, project_key: str) -> list["SessionStoreListEntry"]:
|
|
"""List main sessions stored under a project key."""
|
|
project_dir = self._project_dir(project_key)
|
|
if not project_dir.is_dir():
|
|
return []
|
|
return [
|
|
{"session_id": path.stem, "mtime": int(path.stat().st_mtime * 1000)}
|
|
for path in project_dir.glob("*.jsonl")
|
|
if path.is_file()
|
|
]
|
|
|
|
async def delete(self, key: "SessionKey") -> None:
|
|
"""Delete one subkey, or a main session and all of its subkeys."""
|
|
path = self._path_for_key(key)
|
|
if path.exists():
|
|
path.unlink()
|
|
|
|
if not key.get("subpath"):
|
|
session_dir = self._path(key["project_key"], key["session_id"])
|
|
if session_dir.exists():
|
|
shutil.rmtree(session_dir)
|
|
|
|
async def list_subkeys(self, key: "SessionListSubkeysKey") -> list[str]:
|
|
"""List subpaths stored below a main session."""
|
|
session_dir = self._path(key["project_key"], key["session_id"])
|
|
if not session_dir.is_dir():
|
|
return []
|
|
return [
|
|
str(path.relative_to(session_dir).with_suffix(""))
|
|
for path in session_dir.rglob("*.jsonl")
|
|
if path.is_file()
|
|
]
|