Blitzy set the record on SWE-Bench Pro Public: 66.5%, beating the next closest score by 7.4 points. 486 out of 731 tasks solved, independently verified by Quesma. Read the full story in the comments.
Gabe Perez
2mo
7 points ahead is wild - what benchmark were most teams getting stuck on?
Full story here: https://blitzy.com/blog/blitzy-scores-a-record-66-5-on-swe-bench-pro