Qwen2.5 Coder 1.5B
Alibaba · 2024-09-19 · 1.5B parameters
Qwen2.5-Coder-1.5B is Alibaba's 1.54-billion-parameter base code language model in the Qwen2.5-Coder series, announced September 2024. The family builds on Qwen2.5 through continued training on code-focused data reported at 5.5 trillion tokens, covers 92 programming languages, and this exact checkpoint supports 32,768 tokens of context. As a base model it is intended for completion and downstream fine-tuning rather than direct conversational use.
Benchmark scores
| Benchmark | Score |
|---|---|
| ARC AI2 | 45.2 |
| Capability | 96.0 |
| Epoch Capabilities Index (ECI) | 102 |
| GSM8K | 65.8 |
| HellaSwag (Unspecified Scoring Protocol) | 61.8 |
| MMLU | 53.6 |
| WinoGrande | 60.7 |