Atlas

Benchmarks

← All benchmarks

AdvancedIF (rubric mean score)

Chat & Writing

Mean share of satisfied rubric items per response on AdvancedIF's 1,645 prompts. It grants partial credit on the same responses as the pass@1 headline, so it is kept as a diagnostic.

Top models (higher is better)

ModelScore
Gemini 3.1 Pro Preview97.1
Gemini 3.6 Flash96.6
DeepSeek V4.1 Flash96.3
Claude Opus 595.5
Grok 4.695.5
Claude Fable 5.195.4
GPT-5.595.3
GLM-5.395.0
GPT-5.495.0
Grok 4.595.0
Qwen3.5 397B A17B94.9
GPT-6.1 Sol94.8
GPT-6 Sol94.7
GPT-5.6 Sol Pro94.6
GPT-6 Astra94.6
GLM-5.294.4
Muse Spark 1.194.4
Grok 4.794.3
Gemini 3.5 Flash94.1
Claude Haiku 5.594.0
Claude Sonnet 5.594.0
Opus 4.893.5
Claude Opus 5.593.5
GPT-5.6 Terra93.5
Inkling93.5
Opus 4.793.2
GPT-6 Luna93.2
Kimi K2.7 Code93.1
GPT-5.6 Luna93.0
Sonnet 592.9
Sonnet 4.692.4
Kimi K2 Thinking92.4
gpt-oss-120b90.9
MiniMax M388.4
DeepSeek-V3.287.8
MiniMax M2.784.2
Kimi K380.7
Nemotron 3 Ultra 550B A55B (NVFP4)80.3
Claude Fable 579.0
Loading Atlas data…