Atlas

Benchmarks

← All benchmarks

Excel Modeling Benchmark v1.1 Scratch

Professional Work · 2026-10-19

Scratch-mode score on Excel Modeling Benchmark v1.1, where agents build the workbook without a template and are graded by the GPT-6 Luna partial-credit rubric.

Top models (higher is better)

ModelScore
Claude Fable 5.172.7
GPT-6 Astra70.9
Claude Sonnet 5.570.8
Claude Opus 5.570.2
Muse Wonder Full70.0
Gemini 4 Argon70.0
Muse Wonder68.8
Gemini 3.8 Flash68.5
GPT-6 Luna68.1
Grok 4.767.5
DeepSeek V4.1 Flash 101767.3
Hy4 Preview67.1
GPT-6.1 Sol66.9
Kimi K366.8
Step 5 Preview66.6
GLM-5.366.5
Qwen3.8-Max66.3
MiMo-V2.6-Flash65.7
DeepSeek V4 Pro 081365.4
DeepSeek V4.1 Flash65.2
Mistral Large 4 Preview65.1
MiniMax M3.1 Flash63.9
MiMo-V2.6-Pro62.8
Mercury 362.6
GLM-5.3 Flash62.3
Muse Spark Open61.7
Beam 1.0 501B A23B61.0
MiniMax M359.2
Claude Haiku 5.557.7
Inkling-Small43.5
Inkling42.5
Loading Atlas data…