ReMe/benchmark
酱牛肉 9ce29e0c63 feat(meta-reme): adopt single-execution validation with fail-fast option
- Remove retry/attempt model: QueryScheduler failures are now terminal
  instead of requeued; QueryLease no longer carries an attempt number;
  SandboxSpec.max_retries defaults to 0 and is deprecated
- Flatten workspace layout: drop the attempt-<n>/ directory level so
  case results live directly under cases/<case_id>/
- Add fail-fast: new --fail-fast CLI flag, validation.fail_fast config
  key, and ValidationFailFastError that cancels sibling workers and
  writes a run-level failure.json on the first construction or query
  error
- Clarify module boundaries: meta-reme/run.py prepares workspace and
  runs initial validation; meta-reme/validation/run.py validates an
  already prepared workspace
- Update design.md, validation README, and both benchmark configs
- Update tests for single-execution semantics and add fail-fast tests
2026-08-09 18:30:54 +08:00
..
beam feat(meta-reme): adopt single-execution validation with fail-fast option 2026-08-09 18:30:54 +08:00
longmemeval feat(meta-reme): adopt single-execution validation with fail-fast option 2026-08-09 18:30:54 +08:00
toolmemory docs(benchmark): add toolmemory archive (#413) 2026-08-05 16:03:03 +08:00