Atlas

Benchmarks

← All benchmarks

MCP Atlas April 2026 (public 500 tasks)

Agents

Public 500-task subset under Scale's April 2026 revised judge, transient-tool-error retries and 100-tool-call budget. Kept separate from the 1,000-task leaderboard metric. The Inkling-Small source explicitly credits Scale and reports public/all score pairs; these observations retain the public values.

Top models (higher is better)

ModelScore
Gemini 3.5 Flash-Lite79.8
Inkling-Small79.6
Inkling78.8
GPT-5.6 Luna77.0
Qwen3.5 397B A17B74.2
DeepSeek-V4-Flash69.0
MiniMax M2.749.4
Nemotron 3 Ultra 550B A55B47.4
Loading Atlas data…