Qwen2.5 Coder 0.5B
Alibaba · 2024-11-12 · 494M parameters
Qwen2.5-Coder-0.5B is Alibaba's smallest base code language model in the Qwen2.5-Coder series, released with the expanded family on November 12, 2024. Qwen reports that the Coder family was continued-pretrained on over 5.5 trillion tokens, with the public-repository source-code component spanning 92 programming languages; this exact checkpoint has 494,032,768 parameters and a 32,768-token context window. As a base model, it is intended for code completion and downstream post-training rather than direct conversational use.
Benchmark scores
| Benchmark | Score |
|---|---|
| Epoch Capabilities Index (ECI) | 87.4 |