Atlas

Benchmarks

← All benchmarks

Roboflow Vision Evals — OCR Transcription (October)

Multimodal

Character similarity for transcribed documents and text regions in the October OCR suite. Single preliminary run per effort tier; question count unreported.

Top models (higher is better)

ModelScore
GPT-6 Astra97.5
Claude Opus 5.596.7
GPT-6.1 Sol96.0
Claude Fable 5.195.2
Claude Haiku 5.594.7
Gemini 3.8 Flash94.1
Claude Opus 592.7
GPT-5.6 Sol92.3
Gemini 3.7 Flash91.9
GPT-6 Sol91.0
Gemini 3.1 Pro Preview90.8
Gemini 3 Flash Preview90.5
Gemini 3.6 Flash90.3
Claude Fable 590.2
Muse Spark 1.190.1
Gemini 3.5 Flash90.0
GPT-5.589.9
Qwen3.7-Plus (source unspecified)89.7
Grok 4.789.5
Muse Spark 1.289.3
Grok 4.689.0
Gemini 3.5 Flash-Lite88.6
Sonnet 588.6
Gemini 2.5 Pro87.3
Qwen3.8 Flash87.3
Qwen3.5-27B86.1
Grok 4.586.1
Qwen3.7 Flash84.4
Qwen3-VL-235B-A22B-Instruct84.3
GPT-6 Luna84.0
GPT-5.6 Luna83.5
Muse Glimmer 30B82.9
GLM-5.3 Flash81.5
Kimi K380.4
GPT-5.6 Terra80.2
GPT-5.4 Mini78.5
GLM 5V Turbo78.0
Kimi K2.677.9
Claude Sonnet 5.576.3
Mistral Large 4 Preview75.3
Loading Atlas data…