Atlas

Models

← All models

Qwen2.5 14B Instruct

Alibaba · 2024-09-19 · 14.8B parameters

Qwen2.5-14B-Instruct is Alibaba's 14.7-billion-parameter instruction-tuned language model from the Qwen2.5 series, released September 19, 2024. It is multilingual across more than 29 languages and improves coding, mathematics, instruction following, and structured output generation over Qwen2. Its shipped configuration is set for 32,768-token contexts; Qwen documents extrapolated support to 131,072 tokens using YaRN and Dual Chunk Attention.

Benchmark scores

BenchmarkScore
BBH (Open LLM Leaderboard v2)63.9
BigCodeBench Complete52.2
BigCodeBench Instruct39.8
BigCodeBench-Hard Complete20.9
BigCodeBench-Hard Instruct20.9
Capability122.2
EQ-Bench v279.2
EQ-Bench v2 + MAGI-Hard Combined76.0
Global PIQA - Non-Parallel (Strict Exact Match)73.4
Global PIQA - Parallel (Strict Exact Match)49.0
GPQA (Open LLM Leaderboard v2)32.2
IFEval (Open LLM Leaderboard v2)81.6
MAGI-Hard72.8
MATH Level 5 (Open LLM Leaderboard v2)54.8
MMLU79.9
MMLU-Pro (Open LLM Leaderboard v2)49.0
MuSR (Open LLM Leaderboard v2)41.0
Loading Atlas data…