FrontierCode 1.0 Main - Pass Rate
Code · 2026-06-08
FrontierCode 1.0 Main pass rate on the 100 hardest tasks in the 150-task Extended set, including all 50 Diamond tasks. A trial passes only when it satisfies every blocker criterion, approximating whether a repository maintainer would merge the patch.
Top models (higher is better)
| Model | Score |
|---|---|
| Claude Fable 5 | 49.3 |
| Opus 4.8 | 37.3 |
| GPT-5.5 | 28.3 |
| Opus 4.7 | 26.2 |
| Kimi K2.7 Code | 24.3 |
| GLM-5.2 | 21.2 |
| GPT-5.4 Mini | 20.0 |
| Gemini 3.1 Pro Preview | 18.7 |
| Kimi K2.6 | 18.0 |
| Sonnet 4.6 | 16.9 |
| Qwen3.6 Plus (2026-04-02) | 10.8 |
| Kimi K2.5 | 7.5 |
| MiniMax M2.7 | 6.7 |
| SWE-1.6 | 6.1 |
| MiniMax M2.5 | 6.0 |
| Gemini 3.1 Flash-Lite Preview | 5.3 |