Qwen2.5-Coder-7B-Instruct
Alibaba · 2024-09-19 · 7.6B parameters
Qwen2.5-Coder-7B-Instruct is Alibaba's instruction-tuned 7B code model, released September 19, 2024. Qwen reports that the Coder family was continued-pretrained on over 5.5 trillion tokens, with its public-repository source-code component spanning 92 programming languages; this checkpoint was then post-trained for coding assistance. The released configuration is set to 32,768 tokens and supports extrapolation to 131,072 tokens with YaRN for long-context use.