Atlas

Models

← All models

StarCoder2-7B

Hugging Face · 2024-02-28 · 7.2B parameters

StarCoder2-7B is the Hugging Face-trained medium member of BigCode’s open code-model family. The technical report describes an approximately 3.5-trillion-token base stage followed by an approximately 200-billion-token long-context stage on the StarCoder2 pretraining corpus, using fill-in-the-middle training, grouped-query attention, and 4,096-token sliding-window attention within a 16,384-token context. It is a base model for code completion and infilling, not an instruction-tuned assistant.

Benchmark scores

BenchmarkScore
ARC AI238.7
BBH (Open LLM Leaderboard v2)36.6
BigCodeBench Complete27.7
BigCodeBench-Hard Complete8.8
Capability85.4
Epoch Capabilities Index (ECI)92.0
GPQA (Open LLM Leaderboard v2)25.2
GSM8K32.7
IFEval (Open LLM Leaderboard v2)22.1
MATH Level 5 (Open LLM Leaderboard v2)3.1
MMLU38.8
MMLU-Pro (Open LLM Leaderboard v2)16.4
MuSR (Open LLM Leaderboard v2)37.9
WinoGrande57.1
Loading Atlas data…