Atlas

Models

← All models

Qwen2.5 72B

Alibaba · 2024-09-19 · 72.7B parameters

Qwen2.5-72B is Alibaba's 72.7B open-weight base (pretrain) model in the Qwen2.5 series, released September 2024. It was trained on a corpus of up to 18 trillion tokens and serves as the foundation for downstream Qwen2.5 instruction-tuned and specialized variants.

Benchmark scores

BenchmarkScore
ARC AI294.5
BBH (BIG-Bench Hard)79.8
BBH (Open LLM Leaderboard v2)68.0
Capability124.0
Epoch Capabilities Index (ECI)129
Global PIQA - Non-Parallel (Log-Likelihood Accuracy)60.2
Global PIQA - Parallel (Log-Likelihood Accuracy)29.8
GPQA (Open LLM Leaderboard v2)40.5
HellaSwag (Unspecified Scoring Protocol)84.8
IFEval (Open LLM Leaderboard v2)41.4
MATH Level 5 (Open LLM Leaderboard v2)39.1
MEDIC (clinical summarization)84.1
MEDIC (closed-ended)75.0
MEDIC (open-ended Elo)1261
MMLU85.0
MMLU-Pro (Open LLM Leaderboard v2)59.7
MuSR (Open LLM Leaderboard v2)47.7
PIQA82.6
TriviaQA71.9
WinoGrande82.3
Loading Atlas data…