Qwen2.5 Coder 0.5B
Alibaba · 2024-11-12 · 494M parameters
Qwen2.5-Coder-0.5B is Alibaba's smallest base code language model in the Qwen2.5-Coder series, released with the expanded family on November 12, 2024. Qwen reports that the Coder family was continued-pretrained on over 5.5 trillion tokens, with the public-repository source-code component spanning 92 programming languages; this exact checkpoint has 494,032,768 parameters and a 32,768-token context window. As a base model, it is intended for code completion and downstream post-training rather than direct conversational use.
Benchmark scores
| Benchmark | Score |
|---|---|
| ARC AI2 | 34.4 |
| Capability | 82.1 |
| Epoch Capabilities Index (ECI) | 86.4 |
| GSM8K | 34.5 |
| HellaSwag (Unspecified Scoring Protocol) | 48.4 |
| MMLU | 42.0 |
| WinoGrande | 54.8 |