Phi-2
Microsoft Research · 2023-12-12 · 2.8B parameters
Phi-2 is Microsoft's 2.7-billion-parameter dense base Transformer, released on December 12, 2023 and trained on a reported 1.4 trillion tokens through multiple passes over synthetic and filtered web data for NLP and code. It uses a 2,048-token context and was released without instruction tuning or RLHF for research on small language models and safety.