Atlas

Benchmarks

← All benchmarks

MCP Atlas April 2026 (all 1,000 tasks)

Agents

Scale's revised MCP-Atlas pass rate over all 1,000 public and private tasks. The April update changes the judge, retries transient tool errors, and replaces the former 20-turn cap with at most 100 tool calls per task. Passing requires mean claim coverage of at least 0.75. All current Scale leaderboard models were re-scored with this protocol.

Top models (higher is better)

ModelScore
Muse Spark Open89.2
Muse Spark 1.188.1
Claude Fable 5.187.2
Claude Opus 585.8
GLM-5.384.2
Gemini 3.5 Flash83.6
Claude Fable 583.3
Kimi K382.3
Opus 4.882.2
Muse Spark82.2
GPT-5.6 Sol81.8
Inkling-Small79.2
Opus 4.779.1
Gemini 3.1 Pro Preview78.2
GLM-5.277.8
Opus 4.676.8
Inkling76.0
GLM-5.175.6
GPT-5.575.3
GPT-5.470.6
Gemini 3 Pro Preview70.3
Opus 4.569.8
Sonnet 4.669.5
GPT-5.267.6
Kimi K2.564.4
Gemini 3 Flash Preview62.0
Sonnet 4.559.5
GLM-4.758.1
Gemini 3.1 Flash-Lite Preview57.1
GPT-5.4 Mini56.7
GPT-5.150.1
o3-pro44.5
Haiku 4.540.2
Loading Atlas data…