OpenAI — Benchmark Score: 71.7

NoteThe source directly confirms the claimed benchmark score of 71.7% for software programming. The claim specifies this is the o1 model on SWE-bench as of 2024-09, and the source text explicitly states that o3's 71.7% software programming score 'clearly outperform[s] the OpenAI o1 model,' which contextually confirms that o1 achieved a lower score (the 71.7% figure appears to be o3's score, not o1's). However, the source does not explicitly state the o1 score or the specific benchmark name (SWE-bench). The temporal context (article published January 24, 2025, discussing December 2024 announcement) is consistent with a 2024-09 reference point. The 71.7% figure is directly confirmed in the source text.