Jamba 1.5 Mini
AI21 Labs · 2024-08-22 · 51.6B parameters
Jamba 1.5 Mini is AI21 Labs' compact hybrid SSM-Transformer model released in August 2024, with approximately 52B total parameters and 12B active parameters and a 256K-token context window. It shares the same Mamba-Transformer hybrid architecture as Jamba 1.5 Large, offering faster long-context inference at a smaller scale suitable for lower-resource deployments. The model is intended for enterprise chat, retrieval, and instruction-following tasks where low latency is a priority.