Atlas

Benchmarks

← All benchmarks

Arena Alignment — Deceptive Completion

Safety · 2026-10-08

Conversation-length-adjusted rate of Agent Arena sessions flagged for claiming an outcome is complete when the record contradicts that claim. Diagnostic model-level session statistic; no capability-fit contribution.

Top models (lower is better)

ModelScore
GPT-6.1 Sol2.3
GPT-6 Sol2.4
GPT-6 Astra2.8
GPT-6 Luna2.9
GPT-5.6 Sol6.1
Claude Opus 5.56.4
Grok 4.77.3
Claude Sonnet 5.59.5
Grok 4.69.6
Claude Fable 5.110.5
Gemini 4 Argon12.9
Hy4 Preview13.2
DeepSeek V4.1 Flash14.6
Claude Opus 514.7
Sonnet 515.8
Gemini 3.8 Flash16.3
Muse Spark 1.316.7
Opus 4.817.3
GLM-5.317.9
MiMo-V2.6-Pro18.3
Kimi K318.4
Gemini 3.7 Flash18.6
Qwen3.8 27B19.3
Gemini 3.6 Flash20.6
MiniMax M322.5
Inkling23.0
Loading Atlas data…