DeepSeek R1 Distill Qwen 14B
DeepSeek · 2025-01-20 · 14.8B parameters
DeepSeek-R1-Distill-Qwen-14B is a dense reasoning checkpoint produced by supervised fine-tuning of Qwen2.5-14B on 800k samples curated with DeepSeek-R1, without an RL stage. Released January 20, 2025 under the MIT license, its architecture config declares 131,072 positions, while the distillation fine-tuning used a maximum sequence length of 32,768 tokens.