Motif-3-Beta
Motif Technologies · 2026-07-20 · 314.8B parameters
Motif-3-Beta is a preview checkpoint for the in-house sparse Mixture-of-Experts causal language model developed by Motif Technologies. The released checkpoint contains 314,841,775,750 parameters; the model card reports about 13 billion active parameters per token and top-8 routing across 384 experts plus one shared expert. Its chat template can enable or suppress a reasoning trace, and it supports multilingual text generation with a native 262,144-token context, Grouped Differential Latent Attention, Grouped PolyNorm, and modified mHC components.