MMLU Pro (CAISI science 1,000)
Science · 2025-09-30
CAISI's MMLU-Pro science subset contains 1,000 randomly selected questions from mathematics, physics, chemistry, engineering, biology, and computer science. All evaluated models receive the same selection, and scores report multiple-choice accuracy.
Top models (higher is better)
| Model | Score |
|---|---|
| Opus 4 | 90.2 |
| GPT-5 | 89.8 |
| DeepSeek-R1-0528 | 89.7 |
| DeepSeek-V3.1 | 89.0 |
| DeepSeek-R1 | 87.5 |
| gpt-oss-120b | 85.5 |