MGSM Swahili
Math · 2022-10-06
Swahili language split of the MGSM multilingual grade-school math benchmark.
Top models (higher is better)
| Model | Score |
|---|---|
| Opus 4.5 | 97.2 |
| Gemini 3 Flash Preview | 97.2 |
| Gemini 3 Pro Preview | 97.2 |
| GPT-5.2 | 96.4 |
| GPT-5.1 | 95.6 |
| o3 | 95.6 |
| Opus 4.1 | 95.2 |
| Gemini 2.5 Flash Preview (09-2025) | 95.2 |
| Claude 3.7 Sonnet | 94.8 |
| Sonnet 4.5 | 94.8 |
| GPT-5 | 94.4 |
| Sonnet 4 | 94.0 |
| Claude 3.5 Sonnet (Oct 2024) | 93.2 |
| Opus 4 | 93.2 |
| Grok 4.1 Fast | 93.2 |
| O1 | 93.2 |
| O4 Mini | 93.2 |
| DeepSeek-V3.2 | 92.8 |
| GPT-4.1 | 92.8 |
| Grok 3 Mini | 92.0 |
| Llama 4 Maverick Instruct | 92.0 |
| Haiku 4.5 | 91.6 |
| GPT-4o (2024-08-06) | 91.6 |
| GPT-4o (2024-11-20) | 91.6 |
| GPT-5 Mini | 91.6 |
| Grok 3 | 91.6 |
| Kimi K2 Thinking | 91.6 |
| GLM 4.6 | 91.2 |
| DeepSeek-R1 | 90.8 |
| Gemini 2.5 Flash-Lite Preview (09-2025) | 90.8 |
| Grok 4 Fast | 90.8 |
| Gemini 2.0 Flash 001 | 90.4 |
| Qwen3-235B-A22B | 90.4 |
| GLM-4.7 | 89.6 |
| Llama 4 Scout Instruct | 89.6 |
| Qwen3 Max (rolling alias) | 89.6 |
| GLM-4.5 | 89.2 |
| Llama 3.3 70B Instruct | 89.2 |
| o3-mini | 89.2 |
| gpt-oss-120b | 88.8 |