Atlas

Models

← All models

DBRX Instruct

Databricks · 2024-03-27 · 131.6B parameters

DBRX Instruct is Databricks' open-weight instruction-following model released in March 2024, built on a fine-grained Mixture-of-Experts architecture described by Databricks as having 132B total parameters and 36B active parameters per input. Its base model was pre-trained on a reported 12 trillion tokens of text and code, and it supports a 32K context window. DBRX Instruct was released under the Databricks Open Model License on Hugging Face alongside the DBRX Base model.

Benchmark scores

BenchmarkScore
AlpacaEval 2.0 (length-controlled win rate)25.4
AlpacaEval 2.0 (raw win rate)18.4
Artificial Analysis Intelligence Index3.0
BBH (Open LLM Leaderboard v2)54.3
Capability112.5
EQ-Bench v276.8
EQ-Bench v2 + MAGI-Hard Combined67.0
GPQA (Open LLM Leaderboard v2)34.1
Humanity's Last Exam (Text-Only)6.6
IFEval (Open LLM Leaderboard v2)54.2
LiveCodeBench (Artificial Analysis)9.3
MAGI-Hard57.1
MATH Level 511.7
MATH Level 5 (Open LLM Leaderboard v2)6.9
MATH-500 (Artificial Analysis source)27.9
MMLU74.1
MMLU Pro39.7
MMLU-Pro (Open LLM Leaderboard v2)36.8
MuSR (Open LLM Leaderboard v2)42.7
SciCode (Artificial Analysis)11.8
Loading Atlas data…