Benchmark checker Knowledge and reasoning

Is ARC-AGI-3 still meaningful?

Status:Contested Checked against the report, 5 November 2026

Verdict

Yes, but only with the harness named. One adapter moves the top score by 37 points.

Why contested: The harness decides the score. GPT-6 Astra scores 62.7% on the standard harness and 99.9% with a provider adapter.[1][1] ARC-AGI-3 leaderboard data ARC Prize Primary[2][2] GPT-6 Astra on ARC-AGI-3 ARC Prize Primary

What “Contested” means

Known problems

  • Every frontier model scored under 1% at launch in March 2026.[3][3] ARC-AGI-3 launch OfficeChai Secondary
  • A provider adapter keeps the model's hidden reasoning state between turns. With it, the same model reached 99.9%.[2][2] GPT-6 Astra on ARC-AGI-3 ARC Prize Primary
  • OpenAI's launch table uses OpenAI's own adapter.[4][4] GPT-6 Astra launch OpenAI Vendor
  • Open and Chinese models stay low, with DeepSeek V4.1 Flash at 5.8%.[1][1] ARC-AGI-3 leaderboard data ARC Prize Primary
  • ARC Prize says the result is not proof of AGI, and it names no ARC-AGI-4 yet.[2][2] GPT-6 Astra on ARC-AGI-3 ARC Prize Primary

What to look at instead

The report names no direct successor.

Where it appears in the report

Chapter 1, Benchmarks

Sources

Copied from the chapter source lists. Each number links back to the source in its chapter.

  1. [1]
    ARC-AGI-3 leaderboard data, ARC Prize. Standard and adapter scores with costs. Primary arcprize.org Chapter 1, source 10
  2. [2]
    GPT-6 Astra on ARC-AGI-3, ARC Prize. The provider adapter and the 99.9% result. Primary arcprize.org Chapter 1, source 9
  3. [3]
    ARC-AGI-3 launch, OfficeChai. It reports launch scores under 1%. Secondary officechai.com Chapter 1, source 40
  4. [4]
    GPT-6 Astra launch, OpenAI. It gives OpenAI's capability, cyber and alignment tables. Vendor openai.com Chapter 1, source 55