Atlas

Models

← All models

Mistral 7B Instruct v0.3

Mistral AI · 2024-05-22 · 7.2B parameters

Mistral 7B Instruct v0.3 is Mistral AI's instruction-fine-tuned version of Mistral 7B v0.3. It supports function calling, uses the SentencePiece-based Mistral Tokenizer V3 with a 32,768-ID vocabulary, and has a 32,768-token context window. Its downloadable weights are released under Apache 2.0, and Mistral marks the v0.3 release retired as of March 30, 2025.

Benchmark scores

BenchmarkScore
AidanBench343
AlpacaEval 2.0 (length-controlled win rate)20.6
AlpacaEval 2.0 (raw win rate)16.7
BBH (Open LLM Leaderboard v2)47.2
BigCodeBench Complete27.3
BigCodeBench Instruct19.5
BigCodeBench-Hard Complete6.1
BigCodeBench-Hard Instruct4.7
Capability102.6
EQ-Bench v263.1
EQ-Bench v2 + MAGI-Hard Combined49.6
Global PIQA - Non-Parallel (Strict Exact Match)54.6
Global PIQA - Parallel (Strict Exact Match)24.2
GPQA (Open LLM Leaderboard v2)27.9
GPQA Diamond15.2
IFEval (Open LLM Leaderboard v2)54.7
MAGI-Hard36.0
MATH Level 53.6
MATH Level 5 (Open LLM Leaderboard v2)3.9
MEDIC (clinical summarization)85.5
MEDIC (closed-ended)49.5
MEDIC (open-ended Elo)1328
MMLU59.9
MMLU-Pro (Open LLM Leaderboard v2)30.8
MuSR (Open LLM Leaderboard v2)37.4
SnakeBench Average Apples0.3
SnakeBench Best Apples2.0
SnakeBench Rating14.7
SnakeBench Total Apples7.0
SnakeBench Win Rate33.3
Loading Atlas data…