Commit graph

7 commits

Author SHA1 Message Date
酱牛肉
b5471e668d support agent scope 2.0.5 2026-07-30 18:14:58 +08:00
酱牛肉
793136a5cf fix(evaluation): preserve complete token usage metrics 2026-07-30 15:13:54 +08:00
sa-buc
dc66a0e95e benchmark统计输出改用标准差
- beam/longmemeval 的工具调用与 token 统计由方差改为标准差输出
- 修复 lint: 局部变量遮蔽 importlib.metadata、补充测试 docstring
- black 格式化
2026-07-30 14:59:08 +08:00
酱牛肉
a028cae33d benchmark输出完整token消耗统计 2026-07-30 14:43:33 +08:00
酱牛肉
26f221e765 token消耗量统计 2026-07-30 14:09:20 +08:00
酱牛肉
e14ff16cac job counter 2026-07-30 12:33:40 +08:00
酱牛肉
4e06d59aca feat(evaluation): add check_job_count interface and report search calls in benchmarks
- Extract _counter_key from BaseJob._record_call for reusable counter lookup
- Add reme.utils.evaluation_interface.check_job_count read-only helper
- Track and report average search calls per query in beam and longmemeval benchmarks
2026-07-30 12:09:57 +08:00