Phi-4
Microsoft Research · 2024-12-12 · 14.7B parameters
Phi-4 is Microsoft's 14B-parameter small language model (SLM) released in December 2024, emphasizing high-quality synthetic training data to achieve strong performance in complex reasoning, mathematics, and coding. It was trained using multi-agent, self-revision synthetic data pipelines and fine-tuned with SFT and DPO alignment. Despite its compact size, Phi-4 is competitive with significantly larger models on reasoning-heavy tasks.