Atlas

Models

← All models

Qwen2.5 Coder 7B

Alibaba · 2024-09-19 · 7.6B parameters

Qwen2.5-Coder-7B is Alibaba's dense 7B-class base code language model in the Qwen2.5-Coder series, continued-pretrained from Qwen2.5 on source code, text-code grounding, synthetic, mathematics, and general-language data; it is the base for the corresponding instruct model. The shipped configuration is set to 32,768 tokens, while Qwen documents support up to 131,072 tokens via YaRN extrapolation.

Benchmark scores

BenchmarkScore
ARC AI260.9
BBH (Open LLM Leaderboard v2)48.6
Capability107.4
Epoch Capabilities Index (ECI)112
GPQA (Open LLM Leaderboard v2)25.9
GSM8K83.9
HellaSwag (Unspecified Scoring Protocol)76.8
IFEval (Open LLM Leaderboard v2)34.5
MATH Level 5 (Open LLM Leaderboard v2)19.2
MMLU68.0
MMLU-Pro (Open LLM Leaderboard v2)36.8
MuSR (Open LLM Leaderboard v2)34.5
WinoGrande72.9
Loading Atlas data…