Atlas

Benchmarks

← All benchmarks

FrontierCS Algorithmic v1.1

Code · 2026-10-18

179 open-ended algorithmic problems, many NP-hard variants of competitive-programming tasks, whose checkers accept any valid answer and score better answers higher. Version 1.1 sets each problem's reference at 60 points and adds the natural log of further improvement, capped at 100, and rescores agent runs made in each lab's official harness. The score is the equal-weight mean over problems, with a missing submission scored 0; version 1.0 scores are not comparable.

Top models (higher is better)

ModelScore
Claude Opus 5.556.5
GPT-6 Astra54.0
Claude Sonnet 5.553.9
GPT-6 Sol52.4
Gemini 3.7 Flash48.0
Gemini 3.8 Flash47.8
Loading Atlas data…