Arctic Instruct
Snowflake · 2024-04-24 · 478.6B parameters
Arctic Instruct is Snowflake AI Research's open instruction-tuned language model, released in April 2024 under the Apache 2.0 license. It uses a dense-MoE hybrid architecture—a 10B dense transformer combined with a residual 128×3.66B MoE layer—totaling 480B parameters with 17B active. Its base model was pretrained from scratch on 3.5 trillion tokens with a focus on enterprise workloads such as SQL generation and coding before instruction tuning.