Name: Grok 2 1212
Author: xAI

Grok 2 1212

xAI · 2024-12-12

Grok 2 1212 is xAI's December 12, 2024 update to Grok 2 with improved accuracy, instruction following, and multilingual capabilities.

Benchmark	Score
Artificial Analysis Intelligence Index	8.0
BuzzBench	51.8
Capability	125.5
Epoch Capabilities Index (ECI)	131
Humanity's Last Exam (Text-Only)	3.8
LiveBench	54.3
LiveCodeBench (Artificial Analysis)	26.7
LLM Creative Story-Writing Benchmark	6.4
MATH Level 5	63.5
MATH-500 (Artificial Analysis source)	77.8
MMLU Pro	70.9
OTIS Mock AIME 2024-2025	11.5
SciCode (Artificial Analysis)	28.5
SimpleBench	22.7
TaxEval v2	67.0
TaxEval v2 - Correctness	54.9
TaxEval v2 - Stepwise Reasoning	79.2
WeirdML (v2)	22.2
ZeroEval	62.8
ZeroEval CRUX	75.3
ZeroEval MATH Level 5	60.9
ZeroEval MMLU-Redux	87.4
ZeroEval ZebraLogic	27.7