DeepSeek R1 Distill Llama 8B
DeepSeek · 2025-01-20 · 8B parameters
DeepSeek-R1-Distill-Llama-8B is a dense, text-only reasoning checkpoint released by DeepSeek on January 20, 2025. It was created by supervised fine-tuning Llama-3.1-8B Base on about 800,000 samples curated with DeepSeek-R1, without an RL stage; the downloadable checkpoint contains exactly 8,030,261,248 parameters. Its model config declares 131,072 maximum positions, while its tokenizer config declares a 16,384-token model maximum.