MGSM Telugu
Math · 2022-10-06
Telugu language split of the MGSM multilingual grade-school math benchmark.
Top models (higher is better)
| Model | Score |
|---|---|
| Gemini 3 Pro Preview | 95.6 |
| Opus 4.1 | 94.8 |
| Gemini 3 Flash Preview | 94.0 |
| GPT-5.2 | 93.6 |
| Opus 4.5 | 93.2 |
| Opus 4 | 92.0 |
| Sonnet 4.5 | 92.0 |
| Claude 3.7 Sonnet | 91.6 |
| Qwen3-235B-A22B | 90.8 |
| Gemini 2.5 Flash Preview (09-2025) | 90.4 |
| Llama 4 Maverick Instruct | 90.0 |
| Sonnet 4 | 89.6 |
| DeepSeek-V3.2 | 89.6 |
| GPT-5.1 | 89.6 |
| GPT-5 | 89.6 |
| GPT-5 Mini | 89.6 |
| O1 | 89.6 |
| Haiku 4.5 | 89.2 |
| DeepSeek-R1 | 89.2 |
| gpt-oss-120b | 88.8 |
| Grok 4 Fast | 88.8 |
| GLM 4.6 | 88.4 |
| GPT-4.1 | 88.4 |
| Gemini 2.5 Flash-Lite Preview (09-2025) | 88.0 |
| Grok 3 | 88.0 |
| Mistral Large 3 675B Instruct 2512 | 88.0 |
| O4 Mini | 88.0 |
| Qwen3 Max Preview | 88.0 |
| Gemini 2.0 Flash 001 | 87.6 |
| o3-mini | 87.6 |
| Qwen3 Max (rolling alias) | 87.6 |
| Claude 3.5 Sonnet (Oct 2024) | 87.2 |
| DeepSeek-V3 | 87.2 |
| GPT-4o (2024-11-20) | 87.2 |
| Grok 3 Mini | 87.2 |
| GPT-4o (2024-08-06) | 86.8 |
| Kimi K2 Instruct | 86.8 |
| Mistral Medium 3 | 86.8 |
| Gemini 1.5 Pro 002 | 86.4 |
| GLM-4.5 | 86.4 |