CodeQwen1.5 7B
Alibaba · 2024-04-16 · 7.3B parameters
CodeQwen1.5-7B is Alibaba's 7-billion-parameter base code language model from the CodeQwen1.5 series, released April 2024. It was pretrained on approximately 3 trillion tokens of code spanning 92 programming languages with a 64K-token context window, and uses grouped-query attention for efficient inference. Qwen2.5-Coder succeeded CodeQwen1.5, and Qwen officially renamed the CodeQwen line to Qwen-Coder in September 2024.
Benchmark scores
| Benchmark | Score |
|---|---|
| ARC AI2 | 35.7 |
| BigCodeBench Complete | 45.6 |
| BigCodeBench-Hard Complete | 15.5 |
| Capability | 89.0 |
| Epoch Capabilities Index (ECI) | 93.3 |
| GSM8K | 37.7 |
| MMLU | 40.5 |
| WinoGrande | 59.8 |