Skip to content

Benchmark checker Knowledge and reasoning

Is HLE-Diamond still meaningful?

New / unproven Checked against the report, 5 November 2026

Promising but unproven. It launched in September 2026 and has no independent audit yet.

Why new / unproven: HLE's maintainers launched it in September 2026, and it is too new for an audit.^{[1][1] Humanity's Last Exam site Primary}

What “New / unproven” means

Known problems

It launched in September 2026, too recently for an audit.^{[1][1] Humanity's Last Exam site Primary}

What to look at instead

The report names no direct successor.

Where it appears in the report

Chapter 1, Benchmarks

Table 3. How each area replaced its saturated benchmarks, oldest first in “Go deeper: Lineage of replacements, by area”
Table 5. Reasoning and knowledge benchmarks: what they measure, who maintains them, the top score on 5 November 2026 and the known flaw in “Go deeper: Reasoning and knowledge benchmarks (17)”

Sources

Copied from the chapter source lists. Each number links back to the source in its chapter.

[1]
Humanity's Last Exam site. It describes HLE, HLE-Rolling and HLE-Diamond. Primary lastexam.ai Chapter 1, source 23
[2]
Introducing HLE-Diamond, Humanity's Last Exam. It gives HLE-Diamond scores with and without tools. Primary lastexam.ai Chapter 1, source 32