scriptoriumadmin/fabro
1
0
Fork 0
mirror of https://github.com/fabro-sh/fabro.git synced 2026-10-11 03:40:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
fabro/evals/swe-bench/scoreboard
History
Bryan Helmkamp 942054c43a Record timeout and sandbox resources in scoreboard metadata 
Adds --timeout, --sandbox-cpu, --sandbox-memory flags to record_results.py.
Re-recorded both existing runs with the new fields.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-16 11:24:56 -04:00
..
haiku-baseline-20260316 Record timeout and sandbox resources in scoreboard metadata 2026-03-16 11:24:56 -04:00
sonnet-baseline-20260316 Record timeout and sandbox resources in scoreboard metadata 2026-03-16 11:24:56 -04:00
leaderboard.json Record Sonnet 4.6 baseline: 55.7% on SWE-Bench-Lite ($39.78) 2026-03-16 11:23:23 -04:00