Jamba Large 1.6
AI21 Labs · 2025-03-06 · 398.6B parameters
Jamba Large 1.6 is AI21 Labs' large-scale hybrid SSM-Transformer model released in March 2025, with approximately 398B total parameters and 94B active parameters in a MoE configuration, and a 256K-token context window. It builds on the Jamba architecture that interleaves Mamba state-space model layers with transformer attention layers to achieve faster long-context inference than comparable pure-transformer models. The model is optimized for enterprise use cases including function calling, grounded generation, structured output, and long-document retrieval.