Atlas

Models

← All models

Command R

Cohere · 2024-03-11 · 35B parameters

Command R is Cohere's original 35B open-weight, dense decoder-only Transformer, released on March 11, 2024 and aligned with supervised fine-tuning and preference training. The checkpoint declares a 131,072-token model maximum while retaining 8,192 maximum position embeddings and a RoPE base period of 8,000,000, corresponding to the model card's advertised 128K support; it is optimized for grounded retrieval-augmented generation, single- and multi-step tool use, and multilingual generation evaluated in 10 languages, and is distinct from Command R 08-2024.

Benchmark scores

BenchmarkScore
Artificial Analysis Intelligence Index2.1
BBH (Open LLM Leaderboard v2)54.1
Capability102.7
EQ-Bench v256.0
EQ-Bench v2 + MAGI-Hard Combined49.7
GPQA (Open LLM Leaderboard v2)30.7
GPQA Diamond28.4
Humanity's Last Exam (Text-Only)4.8
IFEval (Open LLM Leaderboard v2)67.5
LegalBench33.0
LegalBench - Conclusion Tasks14.0
LegalBench - Interpretation Tasks38.7
LegalBench - Issue Tasks8.9
LegalBench - Rhetoric Tasks71.0
LegalBench - Rule Tasks32.2
LiveCodeBench (Artificial Analysis)4.8
MAGI-Hard43.3
MATH Level 5 (Open LLM Leaderboard v2)3.5
MATH-500 (Artificial Analysis source)16.4
MMLU Pro33.8
MMLU-Pro (Open LLM Leaderboard v2)33.7
MuSR (Open LLM Leaderboard v2)45.2
SciCode (Artificial Analysis)6.3
SnorkelSpatial11.8
SnorkelUnderwrite15.3
ZeroEval GSM8K53.0
ZeroEval MMLU-Redux61.1
ZeroEval ZebraLogic9.9
Loading Atlas data…