Atlas

Models

← All models

Qwen2.5-Coder-14B

Alibaba · 2024-11-12 · 14.8B parameters

Qwen2.5-Coder-14B is Alibaba's 14.7-billion-parameter base code model, released with the expanded Qwen2.5-Coder family on November 12, 2024. Qwen reports that the family was continued-pretrained on over 5.5 trillion tokens, with the public-repository source-code component spanning 92 programming languages. The released configuration is set to 32,768 tokens and supports extrapolation to 131,072 tokens with YaRN; as a base checkpoint it is intended for post-training or fill-in-the-middle use rather than direct conversation.

Benchmark scores

BenchmarkScore
ARC AI266.0
BBH (Open LLM Leaderboard v2)58.6
Capability114.2
Epoch Capabilities Index (ECI)116
GPQA (Open LLM Leaderboard v2)29.3
GSM8K88.7
HellaSwag (Unspecified Scoring Protocol)80.2
IFEval (Open LLM Leaderboard v2)34.7
MATH Level 5 (Open LLM Leaderboard v2)22.5
MMLU75.2
MMLU-Pro (Open LLM Leaderboard v2)45.2
MuSR (Open LLM Leaderboard v2)38.7
WinoGrande76.8
Loading Atlas data…