Phi-3-mini-4k-instruct
Microsoft Research · 3.8B parameters
Phi-3-mini-4k-instruct is the June 2024 updated checkpoint in Microsoft's mutable repository, replacing the original April checkpoint retained at the model card's documented earlier revision. Microsoft describes it as a dense 3.8B-class instruction model trained on a reported 4.9 trillion tokens and aligned with SFT and DPO; its current configuration supports 4,096 positions and declares a 2,047-token sliding-attention window.