Hy3 preview-Base
Tencent · 2026-04-23 · 298.8B parameters
Hy3 preview-Base is the pretrained base checkpoint for Tencent's Hy3 preview MoE model, with an approximately 295B-parameter backbone, a 3.8B-parameter multi-token-prediction layer, about 21B active parameters, and a 256K-token context length. It is the foundation model underlying the Hy3 preview instruct release and is reported separately in the release post's pre-trained model benchmark table.
Benchmark scores
| Benchmark | Score |
|---|---|
| PACT Negotiation Average Profit per Round | 16.7 |
| PACT Negotiation Bilateral Rating | 1520 |
| PACT Negotiation CMS | 49.0 |