Atlas

Models

← All models

OLMo 2 1124 7B Instruct

Allen Institute for AI (Ai2) · 2025-01-03 · 7.3B parameters

OLMo-2-1124-7B-Instruct is Ai2's dense text-only OLMo 2 7B instruction checkpoint, post-trained from the OLMo 2 7B base model with supervised fine-tuning on a Tülu 3 SFT mixture, DPO, and RLVR. After the initial November 26, 2024 post-trained release used pre-tokenization logic that differed from the base model, Ai2 retrained the post-trained model and released the corrected weights under the same repository ID on January 3, 2025; the original weights are preserved as OLMo-2-1124-7B-Instruct-preview.

Benchmark scores

BenchmarkScore
AA-LCR0.0
AA-LCR v1.10.0
AIME 2025 (Artificial Analysis avg@10)0.7
Artificial Analysis Openness Index88.9
Capability87.5
GPQA Diamond (Artificial Analysis avg@5)28.8
Humanity's Last Exam (Text-Only)5.4
IFBench (Artificial Analysis avg@5)24.4
LiveCodeBench (Artificial Analysis)4.1
MMLU Pro28.2
SciCode (Artificial Analysis avg@3)3.7
Terminal-Bench Hard0.0
τ²-bench (Telecom)0.0
Loading Atlas data…