jinli.yl
b3a0a2b030
fix(evaluation): clarify usage semantics and atomic counters
2026-07-31 22:09:06 +08:00
酱牛肉
b5471e668d
support agent scope 2.0.5
2026-07-30 18:14:58 +08:00
酱牛肉
793136a5cf
fix(evaluation): preserve complete token usage metrics
2026-07-30 15:13:54 +08:00
sa-buc
dc66a0e95e
benchmark统计输出改用标准差
...
- beam/longmemeval 的工具调用与 token 统计由方差改为标准差输出
- 修复 lint: 局部变量遮蔽 importlib.metadata、补充测试 docstring
- black 格式化
2026-07-30 14:59:08 +08:00
酱牛肉
a028cae33d
benchmark输出完整token消耗统计
2026-07-30 14:43:33 +08:00
酱牛肉
26f221e765
token消耗量统计
2026-07-30 14:09:20 +08:00
酱牛肉
e14ff16cac
job counter
2026-07-30 12:33:40 +08:00
酱牛肉
4e06d59aca
feat(evaluation): add check_job_count interface and report search calls in benchmarks
...
- Extract _counter_key from BaseJob._record_call for reusable counter lookup
- Add reme.utils.evaluation_interface.check_job_count read-only helper
- Track and report average search calls per query in beam and longmemeval benchmarks
2026-07-30 12:09:57 +08:00