docs(plugins): clarify benchmark answer step migration

This commit is contained in:
jinli.yl 2026-09-30 12:13:30 +08:00
parent 17a17439c8
commit a385f41756
4 changed files with 16 additions and 0 deletions

View file

@ -34,5 +34,9 @@ still take precedence. Installing this plugin does not start an evaluation.
Custom Python callers should import memory, search and answer Steps from `reme_beam`, and install
`beam-judge` before importing the judge Step from `judge_beam`. After uninstalling,
Applications and CLI services must omit the plugin until it is installed again.
`BeamAgenticAnswerStep` now implements the answer behavior directly. The former
`reme.steps.benchmark.BaseAgenticAnswerStep` import is gone; custom subclasses can
extend `reme_beam.BeamAgenticAnswerStep` for BEAM behavior, or implement their own
Step using `reme.steps.base_step.BaseStep`.
Uninstallation never removes datasets, workspaces or results.
Restart an existing service after changing plugins.

View file

@ -30,5 +30,9 @@ editable 安装会注册 `beam` entry point,并让源码修改立即生效。r
自定义 Python 调用应从 `reme_beam` 导入记忆、搜索和回答 Step;安装 `beam-judge` 后再从
`judge_beam` 导入评判 Step。
`BeamAgenticAnswerStep` 现在直接实现回答逻辑。原来的
`reme.steps.benchmark.BaseAgenticAnswerStep` 导入路径已移除;自定义子类可继承
`reme_beam.BeamAgenticAnswerStep` 以复用 BEAM 回答行为,或基于
`reme.steps.base_step.BaseStep` 自行实现 Step。
卸载插件后,Application 和 CLI 服务必须移除插件选择,直到再次安装。
卸载不会删除数据集、工作区或结果。修改插件后需重启已有服务。

View file

@ -34,5 +34,9 @@ still take precedence. Installing this plugin does not start an evaluation.
Custom Python callers should import memory, search and answer Steps from `reme_lme`, and install
`lme-judge` before importing the judge Step from `judge_lme`. After uninstalling,
Applications and CLI services must omit the plugin until it is installed again.
`LmeAgenticAnswerStep` now implements the answer behavior directly. The former
`reme.steps.benchmark.BaseAgenticAnswerStep` import is gone; custom subclasses can
extend `reme_lme.LmeAgenticAnswerStep` for LongMemEval behavior, or implement their
own Step using `reme.steps.base_step.BaseStep`.
Uninstallation never removes datasets, workspaces or results.
Restart an existing service after changing plugins.

View file

@ -30,5 +30,9 @@ editable 安装会注册 `lme` entry point,并让源码修改立即生效。ru
自定义 Python 调用应从 `reme_lme` 导入记忆、搜索和回答 Step;安装 `lme-judge` 后再从
`judge_lme` 导入评判 Step。
`LmeAgenticAnswerStep` 现在直接实现回答逻辑。原来的
`reme.steps.benchmark.BaseAgenticAnswerStep` 导入路径已移除;自定义子类可继承
`reme_lme.LmeAgenticAnswerStep` 以复用 LongMemEval 回答行为,或基于
`reme.steps.base_step.BaseStep` 自行实现 Step。
卸载插件后,Application 和 CLI 服务必须移除插件选择,直到再次安装。
卸载不会删除数据集、工作区或结果。修改插件后需重启已有服务。