DBRX Instruct
Databricks · 2024-03-27 · 131.6B parameters
DBRX Instruct is Databricks' open-weight instruction-following model released in March 2024, built on a fine-grained Mixture-of-Experts architecture described by Databricks as having 132B total parameters and 36B active parameters per input. Its base model was pre-trained on a reported 12 trillion tokens of text and code, and it supports a 32K context window. DBRX Instruct was released under the Databricks Open Model License on Hugging Face alongside the DBRX Base model.