mirror of
https://github.com/fabro-sh/fabro.git
synced 2026-09-09 22:33:37 +00:00
record_results.py combines generation + eval results into a git-tracked scoreboard. Per run: README, meta.json, instances.jsonl. Auto-generates leaderboard.json ranked by resolve rate. Haiku 4.5 baseline: 162/300 (54.0%), $26.13 total ($0.087/instance). Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| swe-bench | ||