SMT 2025 (CAISI 58-task set)
Math · 2025-09-30
CAISI's SMT 2025 set contains 58 text-only advanced high-school mathematics problems from the Stanford Math Tournament. It is distinct from Atlas's 53-task MathArena track, and scores report answer accuracy.
Top models (higher is better)
| Model | Score |
|---|---|
| GPT-5.5 | 99.0 |
| GLM-5.2 | 97.8 |
| DeepSeek-V4-Pro | 96.0 |
| Opus 4.8 | 95.7 |
| Claude Mythos Preview | 95.0 |
| Opus 4.6 | 94.0 |
| GPT-5.4 Mini | 92.0 |
| GPT-5 | 91.8 |
| DeepSeek-R1-0528 | 87.6 |
| DeepSeek-V3.1 | 86.2 |
| gpt-oss-120b | 82.3 |
| Opus 4 | 82.2 |
| DeepSeek-R1 | 75.0 |