ERNIE 5.0
Baidu · 2026-01-22
ERNIE 5.0 is Baidu's closed, natively multimodal ultra-sparse Mixture-of-Experts foundation model, formally released on Qianfan on January 22, 2026 after a November 2025 preview; Baidu describes it as having 2.4 trillion parameters with less than 3% activated per token. It was trained from scratch across text, image, video, and audio under a unified autoregressive objective for multimodal understanding and generation, with modality-agnostic expert routing. The report describes training context extension to a rounded 128K tokens, while Qianfan's exact hosted profile reports a 248,832-token total context and text-only output for the ernie-5.0 endpoint; Qianfan also lists that endpoint as a deep-thinking model without an on/off control.