Phi-4-multimodal-instruct
Microsoft Research · 2025-02-26 · 5.6B parameters
Phi-4-multimodal-instruct is Microsoft's open-weight, instruction-tuned 5.6B-class multimodal model, publicly launched on February 26, 2025. It shares Phi-4-Mini-Instruct's 32-layer GQA language backbone and adds image and audio encoders, projectors, and modality-specific LoRA adapters with routing for text-only, vision-language, speech/audio, and combined vision-speech inputs, while generating text. The checkpoint supports a 131,072-token context with LongRoPE and is intended for edge and resource-constrained deployments.