Benchmark checker Speech and voice

Is τ-voice still meaningful?

Status:New / unproven Checked against the report, 5 November 2026

Verdict

Yes. Voice agents keep only 30–45% of text-mode success, so it separates them well.

Why new / unproven: τ-voice appeared at ICML 2026, so outside review is still thin.[1][1] τ-voice, arXiv 2603.13686 Primary[2][2] ICML 2026 poster for τ-voice Primary Its two published harnesses give different numbers.[3][3] Artificial Analysis, speech-to-speech Primary

What “New / unproven” means

Known problems

  • The paper found the best voice agent at 51% with clean audio. Artificial Analysis reported 79.9% on its own harness, and the two may not compare.[1][1] τ-voice, arXiv 2603.13686 Primary[3][3] Artificial Analysis, speech-to-speech Primary
  • Voice agents reach 31–51% with clean audio and 26–38% with realistic noise and accents.[1][1] τ-voice, arXiv 2603.13686 Primary
  • The text-mode reference of 85% pass@1 comes from one model, GPT-5 with reasoning.[1][1] τ-voice, arXiv 2603.13686 Primary

What to look at instead

τ-voice extends τ²-bench to full-duplex voice calls.[1][1] τ-voice, arXiv 2603.13686 Primary

  • τ²-bench Status:Near ceiling Fading. Top scores are high, and the newer τ³-Banking spreads models more.

Where it appears in the report

Chapter 7, Multimodal, voice and embodied

Sources

Copied from the chapter source lists. Each number links back to the source in its chapter.

  1. [1]
    τ-voice, arXiv 2603.13686. Primary arxiv.org Chapter 7, source 10
  2. [2]
    ICML 2026 poster for τ-voice. Primary icml.cc Chapter 7, source 60
  3. [3]
    Artificial Analysis, speech-to-speech. Primary artificialanalysis.ai Chapter 7, source 9