Atlas

Benchmarks

← All benchmarks

Artificial Analysis Coding Agent Index v2.0

Indexes

Artificial Analysis Coding Agent Index v2.0 scores coding-agent and model pairs, such as Claude Code or Codex with a given model and effort, as the equal-weight average of mean scores over three attempts per task on FrontierCode v1.1 (100 tasks), Terminal-Bench 4.0 (66 tasks) and SWE-Atlas-QnA-AA (124 tasks, grading adjusted by Artificial Analysis); attempts flagged for reward hacking score zero. FrontierCode v1.1 replaces v1.5's DeepSWE v1.1, so v2.0 scores are not comparable with v1.5. Scores belong to the agent harness and model together. It is separate from the model-level Artificial Analysis Coding Index.

Top models (higher is better)

ModelScore
Claude Opus 5.561.7
Claude Sonnet 5.559.3
Muse Wonder Full58.9
Claude Fable 5.157.6
GPT-6 Astra54.7
GPT-6.1 Sol54.1
Gemini 4 Argon53.2
Muse Wonder52.0
GLM-5.348.9
DeepSeek V4.1 Flash47.3
Grok 4.746.6
DeepSeek V4.1 Flash 101746.3
Muse Spark 1.345.7
Step 5 Preview43.1
Kimi K341.4
Claude Haiku 5.537.3
Gemini 3.8 Flash33.3
GPT-6 Luna31.1
Muse Spark Open26.3
Beam 1.0 501B A23B20.5
Loading Atlas data…