Qwen2.5 Coder 7B
Alibaba · 2024-09-19 · 7.6B parameters
Qwen2.5-Coder-7B is Alibaba's dense 7B-class base code language model in the Qwen2.5-Coder series, continued-pretrained from Qwen2.5 on source code, text-code grounding, synthetic, mathematics, and general-language data; it is the base for the corresponding instruct model. The shipped configuration is set to 32,768 tokens, while Qwen documents support up to 131,072 tokens via YaRN extrapolation.