Metadata
| Source Table | resources |
| Source ID | 457fa3b0b79d8812 |
| Description | François Chollet reports that OpenAI's o3 model scored 87.5% on the ARC-AGI-1 Semi-Private Evaluation set using high compute (1024 samples), and 75.7% under the $10k budget constraint, representing a dramatic step-function improvement over previous AI systems. This result challenges prior intuitions… |
| Source URL | arcprize.org/blog/oai-o3-pub-breakthrough |
| Children | — |
| Created | Feb 21, 2026, 3:56 PM |
| Updated | Oct 4, 2026, 2:03 AM |
| Synced | — |
Record Data
id | 457fa3b0b79d8812 |
url | arcprize.org/blog/oai-o3-pub-breakthrough |
title | o3 scores 87.5% on ARC-AGI |
type | web |
summary | François Chollet reports that OpenAI's o3 model scored 87.5% on the ARC-AGI-1 Semi-Private Evaluation set using high compute (1024 samples), and 75.7% under the $10k budget constraint, representing a dramatic step-function improvement over previous AI systems. This result challenges prior intuitions… |
review | — |
abstract | — |
keyPoints | [ "o3 scored 75.7% on ARC-AGI Semi-Private Eval within $10k compute budget and 87.5% at 172x higher compute (~$456k).", "This is a massive jump from GPT-4o's ~5%, representing a qualitative shift in novel task adaptation ability not seen before in GPT-family models.", "o3 was trained on 75% of… |
publicationId | — |
authors | — |
authorEntityIds | — |
publishedDate | — |
tags | [ "capabilities", "evaluation", "agi", "benchmarks", "compute", "alignment", "deployment", "technical-safety" ] |
localFilename | — |
credibilityOverride | — |
fetchedAt | — |
contentHash | — |
stableId | sid_i6eVuYOna8 |
fetchStatus | ok |
lastFetchedAt | Oct 4, 2026, 2:03 AM |
archiveUrl | — |
stance | — |
contextNote | Landmark announcement by ARC Prize documenting o3's surprising performance on ARC-AGI-1, widely cited in AI safety and capabilities discussions as evidence of a qualitative shift in AI reasoning abilities as of late 2024. |
resourcePurpose | primary_source |
resourceSubtype | blog_post |
typeMetadata | — |
publisherEntityId | — |
relatedEntityIds | — |
enrichmentStatus | enriched |
enrichmentDate | Apr 2, 2026, 7:07 PM |
importanceScore | 0.82 |
contentLifecycle | — |
Debug info
Thing ID: sid_i6eVuYOna8
Source Table: resources
Source ID: 457fa3b0b79d8812