Atlas

Models

← All models

Mistral Large 2 (Instruct 2407)

Mistral AI · 2024-07-24 · 122.6B parameters

Mistral Large 2 is Mistral AI's July 2024 Mistral-Large-Instruct-2407 checkpoint, a 123B dense instruction-tuned language model with a 128K-token context window. It improved coding, mathematics, reasoning, and multilingual support, and its weights were released under the Mistral Research License.

Benchmark scores

BenchmarkScore
AA-LCR1.7
Agentic Tool Use (Chat)40.4
Agentic Tool Use (Enterprise)50.4
AIME 20250.0
Arabic970
Artificial Analysis Intelligence Index7.3
BigCodeBench-Hard Complete29.7
BigCodeBench-Hard Instruct22.3
BuseyBench SVG2.5
Capability124.4
Chinese1006
Coding1029
Confabulations Leaderboard Confabulation Rate32.2
Confabulations Leaderboard Non-Response Rate10.6
Confabulations Leaderboard Weighted Score21.4
Creative Writing v277.2
Elimination Game TrueSkill Mu4.1
Epoch Capabilities Index (ECI)127
EQ-Bench v285.0
EQ-Bench v2 + MAGI-Hard Combined78.7
Eval Connections5.0
Eval Connections — Guess Accuracy9.1
ForecastBench Baseline Dataset Brier Index56.1
ForecastBench Baseline Market Brier Index57.0
ForecastBench Baseline Overall Brier Index56.6
ForecastBench Preliminary Dataset Brier Index56.1
ForecastBench Tournament Dataset Brier Index56.1
ForecastBench Tournament Market Brier Index69.4
ForecastBench Tournament Overall Brier Index62.2
GPQA Diamond47.2
Loading Atlas data…