GSM8K
Math · 2021-10-27
A grade-school math word problem benchmark focused on multi-step arithmetic reasoning and exact-match solutions.
Top models (higher is better)
| Model | Score |
|---|---|
| Claude 3.5 Sonnet (June 2024) | 96.4 |
| Opus 3 | 95.0 |
| Claude 3 Sonnet | 92.3 |
| GPT-4 | 92.0 |
| Gemini 1.5 Pro | 90.8 |
| Claude 3 Haiku | 88.9 |
| Gemini 1.5 Flash | 86.2 |
| PaLM 2-L | 80.0 |
| Grok 1 | 62.9 |