scriptoriumadmin/fabro
1
0
Fork 0
mirror of https://github.com/fabro-sh/fabro.git synced 2026-10-11 03:40:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
fabro/evals/swe-bench/scoreboard
History
Bryan Helmkamp dfcece9a0d Record Opus 4.6 20min timeout: 58.0% on SWE-Bench-Lite ($218.65) 
100% patch rate, 0 timeouts. Only +1 instance over Sonnet at 4x the cost.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-16 14:43:20 -04:00
..
haiku-baseline-20260316 Record timeout and sandbox resources in scoreboard metadata 2026-03-16 11:24:56 -04:00
opus-20min-20260316 Record Opus 4.6 20min timeout: 58.0% on SWE-Bench-Lite ($218.65) 2026-03-16 14:43:20 -04:00
sonnet-20min-20260316 Record Sonnet 4.6 20min timeout: 57.7% on SWE-Bench-Lite ($55.22) 2026-03-16 13:36:26 -04:00
sonnet-baseline-20260316 Record timeout and sandbox resources in scoreboard metadata 2026-03-16 11:24:56 -04:00
leaderboard.json Record Opus 4.6 20min timeout: 58.0% on SWE-Bench-Lite ($218.65) 2026-03-16 14:43:20 -04:00