Qwen2.5-Coder-14B
Alibaba · 2024-11-12 · 14.8B parameters
Qwen2.5-Coder-14B is Alibaba's 14.7-billion-parameter base code model, released with the expanded Qwen2.5-Coder family on November 12, 2024. Qwen reports that the family was continued-pretrained on over 5.5 trillion tokens, with the public-repository source-code component spanning 92 programming languages. The released configuration is set to 32,768 tokens and supports extrapolation to 131,072 tokens with YaRN; as a base checkpoint it is intended for post-training or fill-in-the-middle use rather than direct conversation.