Atlas

Benchmarks

← All benchmarks

AIME 2025 (MathArena repeated-run mean)

Math · 2025-02-12

MathArena's AIME 2025 protocol reports the mean correctness across repeated runs per question, normally four attempts. The 30-item count records unique questions, not independent single-run Bernoulli trials.

Top models (higher is better)

ModelScore
GPT-5.2100.0
Step 3.5 Flash98.3
Gemini 3 Flash Preview97.5
GLM-596.7
DeepSeek-V3.2-Speciale95.8
Kimi K2.595.8
Gemini 3 Pro Preview95.0
GPT-595.0
DeepSeek-V3.294.2
GPT-5.194.2
GLM-4.593.3
Grok 492.5
Kimi K2 Thinking92.5
DeepSeek-V3.2-Exp91.7
GLM 4.691.7
O4 Mini91.7
DeepSeek-V3.190.8
Grok 4 Fast90.8
gpt-oss-120b90.0
DeepSeek-R1-052889.2
gpt-oss-20b89.2
Grok 4.1 Fast89.2
o389.2
Gemini 2.5 Pro88.3
GPT-5 Mini87.5
Falcon H1R 7B86.7
o3-mini86.7
GPT-5 Nano85.0
Sonnet 4.584.2
Gemini 2.5 Pro Preview 05-0683.3
GLM 4.5 Air83.3
K2-Think83.3
Grok 3 Mini81.7
o1 (2024-12-17)81.7
Qwen3-235B-A22B80.8
QED-Nano77.5
Gemini 2.5 Flash70.8
Opus 470.0
DeepSeek-R170.0
Qwen3-30B-A3B70.0
Loading Atlas data…