Phi-3.5 Mini Instruct
Microsoft Research · 2024-08-22 · 3.8B parameters
Phi-3.5 Mini Instruct is Microsoft's dense, instruction-tuned Phi-3.5 small language model, announced on August 22, 2024. The 3.8B-class checkpoint supports a 131,072-token context through LongRoPE and was trained on a reported 3.4 trillion-token mixture, followed by SFT, PPO, and DPO, with improved multilingual and long-context capability over the June 2024 Phi-3 Mini update. Microsoft publishes the text-in, text-out weights under the MIT license.