PUMaC 2024 (CAISI 55-task set)
Math · 2025-09-30
CAISI's PUMaC 2024 set contains 55 text-only advanced high-school mathematics problems without visual diagrams. Problems cover algebra, number theory, combinatorics, and geometry, and scores report answer accuracy.
Top models (higher is better)
| Model | Score |
|---|---|
| Claude Mythos Preview | 97.7 |
| Opus 4.8 | 97.3 |
| GPT-5.5 | 96.4 |
| DeepSeek-V4-Pro | 96.4 |
| GLM-5.2 | 95.5 |
| Opus 4.6 | 95.0 |
| GPT-5.4 Mini | 93.0 |
| GPT-5 | 85.9 |
| DeepSeek-V3.1 | 77.7 |
| DeepSeek-R1-0528 | 72.7 |
| Opus 4 | 69.1 |
| gpt-oss-120b | 67.3 |
| DeepSeek-R1 | 60.9 |