Phi-3 Mini 128K Instruct
Microsoft Research · 3.8B parameters
Phi-3 Mini 128K Instruct is the June 2024 updated checkpoint in Microsoft's mutable Phi-3 Mini 128K repository. It is a dense, instruction-tuned 3.8B-class text model trained on a reported 4.9 trillion tokens and post-trained with SFT and DPO; LongRoPE extends its 4,096-position base to a 131,072-token context. The original April 2024 checkpoint remains available at the model card's documented earlier revision.