fabro/evals
Bryan Helmkamp e152bbfd37
Make SWE-bench patch generation and evaluation resumable
On restart, reads existing output JSONL files to find completed instance
IDs, skips them, and appends new results. Final summary recomputes from
the full results file so it reflects all runs combined.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-16 10:33:06 -04:00
..
swe-bench Make SWE-bench patch generation and evaluation resumable 2026-03-16 10:33:06 -04:00