Atlas

Benchmarks

← All benchmarks

Radiology's Last Exam 2.0 (RadLE-C)

Multimodal

Radiology's Last Exam 2.0 (RadLE 2.0) evaluates autonomous single-image spot diagnosis across 200 radiology cases. Its primary RadLE-C Confidence Weighted Index rewards correct diagnoses and penalizes incorrect diagnoses in proportion to the model's reported confidence, with an explicit 'I don't know' receiving no credit or penalty.

Top models (higher is better)

ModelScore
Human Expert Baseline (RadLE 2.0)989
Claude Fable 5758
Muse Spark 1.1735
GPT-5.6 Sol Pro665
Gemini 3.1 Pro Preview660
OctoMed-7B541
Grok 4.5524
Nemotron 3 Nano Omni 30B A3B476
Qwen3.7-Plus472
GLM 5V Turbo409
MiniMax M3350
Gemma 4 31B (RadLE 2.0 label)336
Lingshu-32B284
MedGemma 1.5 4B IT277
Llama 4 Maverick (RadLE 2.0 label)263
InternVL3.5-8B241
Mistral Large 3 2512 (RadLE 2.0 label)181
Loading Atlas data…