ERNIE 4.5 21B A3B
Baidu · 2025-06-30 · 21.9B parameters
ERNIE 4.5 21B A3B is Baidu's PaddlePaddle-format checkpoint for the post-trained, non-thinking text MoE in the ERNIE 4.5 family. Baidu describes the model as having about 21B total parameters and 3B activated per token; its MoE layers route each token to six of 64 text experts alongside two shared experts and it supports a 131,072-token context under Apache 2.0.
Benchmark scores
| Benchmark | Score |
|---|---|
| Eval Connections | 0.0 |
| Eval Connections — Guess Accuracy | 18.2 |
| SnakeBench Average Apples | 1.9 |
| SnakeBench Best Apples | 5.0 |
| SnakeBench Rating | 18.4 |
| SnakeBench Total Apples | 30.0 |
| SnakeBench Win Rate | 26.7 |