ReMe/benchmark/beam
sa-buc bb7a436d51 feat: improve agentic answer prompt and update beam 100K results
- Strengthen abstention rule: prohibit extrapolation from related but
  non-direct evidence
- Add multi-angle search after preliminary answer to check for
  conflicting/supplementary/updated information
- Add max-iteration fallback to 'Information not found'
- Update beam.md with 100K results (agentscope 2.0.4.post1, from scratch)
  including per-type token consumption and memory construction stats
- config.yaml: 100K dataset, 20 workers for BEAM evaluation
- run.py: add memory construction token usage tracking (default agent)
- Overall: 0.635 → 0.654 (+0.019), contradiction_resolution: 0.338 → 0.478
  (+0.140), abstention: 0.500 → 0.525 (+0.025)
2026-08-05 01:48:54 +08:00
..
config.yaml feat: improve agentic answer prompt and update beam 100K results 2026-08-05 01:48:54 +08:00
run.py feat: improve agentic answer prompt and update beam 100K results 2026-08-05 01:48:54 +08:00