Atlas

Benchmarks

← All benchmarks

Roboflow Vision Evals (October 2026, five tasks)

Multimodal

Unweighted mean of five low-tier task headlines: detection mAP@50, the redesigned four-category OCR benchmark, and Gemini 3.5 Flash temperature-zero judged counting, identification and reasoning. Excludes models with missing OCR results. October marks the observed protocol change, not an upstream version number. Atomic sample counts unreported.

Top models (higher is better)

ModelScore
GPT-6 Astra83.4
Claude Opus 5.582.0
Gemini 3.5 Flash81.8
GPT-6.1 Sol81.7
Gemini 3.7 Flash80.1
Gemini 3.8 Flash79.8
Claude Sonnet 5.577.6
Gemini 3.6 Flash77.1
GPT-6 Sol76.9
Gemini 3.1 Pro Preview76.8
Claude Fable 5.174.7
Muse Spark 1.174.4
Muse Spark 1.273.8
GPT-5.6 Sol72.4
Claude Fable 571.7
Claude Opus 570.9
GPT-6 Luna69.7
Claude Haiku 5.569.6
GPT-5.566.0
GPT-5.6 Terra66.0
Gemini 3 Flash Preview65.7
GPT-5.6 Luna64.7
Grok 4.763.5
Gemini 3.5 Flash-Lite61.7
Muse Glimmer 30B61.4
Qwen3.8 Flash59.7
Grok 4.659.1
Qwen3.7-Plus (source unspecified)58.9
Opus 4.858.3
Gemini 2.5 Pro57.6
Mistral Large 4 Preview56.8
Kimi K356.0
GLM-5.3 Flash55.8
Grok 4.555.3
Sonnet 555.3
Qwen3-VL-235B-A22B-Instruct55.2
GLM 5V Turbo54.6
GPT-5.4 Mini53.2
Kimi K2.652.8
Qwen3.7 Flash52.4
Loading Atlas data…