fabro/evals
Bryan Helmkamp f3efcc931e Record GPT-5.4 20min timeout: 65.7% on SWE-Bench-Lite ($718.62)
Best resolve rate at 197/300 but 3.3x more expensive than Opus.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-16 20:55:59 -04:00
..
swe-bench Record GPT-5.4 20min timeout: 65.7% on SWE-Bench-Lite ($718.62) 2026-03-16 20:55:59 -04:00