LMArena Agent Arena Chat Confirmed Success
Agents · 2026-08-14
Signed percentage-point Agent Arena Chat category diagnostic signal for sessions where the user explicitly confirmed task completion, recomputed on sessions tagged as general agentic chat such as creative writing, learning, everyday research and media generation. Values may be negative relative to the category baseline; reported confidence intervals are not standard errors.
Top models (higher is better)
| Model | Score |
|---|---|
| Claude Opus 5.5 | 29.8 |
| Claude Sonnet 5.5 | 22.1 |
| Claude Fable 5.1 | 19.2 |
| Gemini 4 Argon | 19.1 |
| GPT-6 Astra | 17.4 |
| Muse Wonder Full | 14.9 |
| Grok 4.7 | 13.8 |
| GPT-6.1 Sol | 13.7 |
| Claude Opus 5 | 12.8 |
| DeepSeek V4.1 Flash 1017 | 12.7 |
| Gemini 3.8 Flash | 11.7 |
| GPT-6 Sol | 8.6 |
| Muse Wonder | 8.5 |
| MiMo-V2.6-Pro | 8.3 |
| Claude Fable 5 | 6.1 |
| DeepSeek V4.1 Flash | 6.0 |
| Hy4 Preview | 5.7 |
| Qwen3.8-Max | 5.5 |
| Kimi K3 | 5.4 |
| Muse Spark 1.3 | 5.2 |
| Gemini 3.7 Flash | 4.7 |
| GLM-5.3 Flash | 3.4 |
| MiMo-V2.6-Flash | 3.4 |
| GPT-5.6 Sol | 2.4 |
| Mistral Large 4 Preview | 2.0 |
| Muse Spark 1.1 | 1.5 |
| GPT-6 Luna | 0.4 |
| GLM-5.3 | 0.3 |
| Qwen3.8-Flash-Next | 0.3 |
| Claude Haiku 5.5 | -0.5 |
| Grok 4.6 | -1.1 |
| GLM-5.2 | -2.0 |
| GPT-5.6 Terra | -2.4 |
| Step 5 Preview | -2.5 |
| Qwen3.8 27B | -2.6 |
| GPT-5.5 | -3.6 |
| Sonnet 5 | -3.8 |
| Muse Spark 1.2 | -4.2 |
| Qwen3.7-Plus (source unspecified) | -4.6 |
| GPT-5.4 | -6.5 |