OTIS-AIME 2025 (CAISI 30-task set)
Math · 2025-09-30
CAISI's OTIS-AIME 2025 set contains 30 advanced high-school mathematics problems with integer answers between 0 and 999. It is a different set from Atlas's 45-task OTIS Mock AIME 2024-2025 benchmark, and scores report answer accuracy.
Top models (higher is better)
| Model | Score |
|---|---|
| GPT-5.5 | 100.0 |
| Claude Mythos Preview | 99.5 |
| GLM-5.2 | 98.6 |
| Opus 4.8 | 97.1 |
| DeepSeek-V4-Pro | 97.1 |
| Opus 4.6 | 92.0 |
| GPT-5 | 91.9 |
| GPT-5.4 Mini | 90.0 |
| DeepSeek-V3.1 | 77.6 |
| DeepSeek-R1-0528 | 73.3 |
| gpt-oss-120b | 72.9 |
| Opus 4 | 66.7 |
| DeepSeek-R1 | 58.3 |