Atlas

Benchmarks

← All benchmarks

FrontierCode 1.0 Diamond - Pass Rate

Code · 2026-06-08

FrontierCode 1.0 Diamond pass rate on the original benchmark's 50 hardest production-code tasks. A trial passes only when it satisfies every blocker criterion, approximating whether a repository maintainer would merge the patch. Cognition deprecated Diamond in FrontierCode 1.1.

Top models (higher is better)

ModelScore
Opus 4.814.5
GPT-5.57.2
Opus 4.75.6
Gemini 3.1 Pro Preview5.3
GPT-5.4 Mini4.8
Sonnet 4.64.0
Kimi K2.64.0
SWE-1.62.9
MiniMax M2.72.7
MiniMax M2.51.3
Kimi K2.51.0
Gemini 3.1 Flash-Lite Preview0.7
Loading Atlas data…