Atlas

Models

← All models

Grok Beta

xAI · 2024-11-04

Grok Beta is xAI's public beta release of the Grok enterprise model, launched in November 2024 as the initial API offering for developers. It supports a 128,000-token context window, function calling, and system prompts, and its REST API was designed to be compatible with the OpenAI SDK to simplify migration. The model served as a preview of Grok's enterprise capabilities ahead of the full Grok 2 API launch.

Benchmark scores

BenchmarkScore
AidanBench823
Artificial Analysis Intelligence Index7.5
BigCodeBench-Hard Complete29.7
BigCodeBench-Hard Instruct23.6
Capability126.3
Creative Writing v278.1
ForecastBench Baseline Dataset Brier Index58.5
ForecastBench Baseline Market Brier Index62.3
ForecastBench Baseline Overall Brier Index60.4
ForecastBench Preliminary Dataset Brier Index58.5
ForecastBench Tournament Dataset Brier Index58.5
ForecastBench Tournament Market Brier Index71.5
ForecastBench Tournament Overall Brier Index64.4
GPQA Diamond47.1
Humanity's Last Exam (Text-Only)4.7
LiveCodeBench (Artificial Analysis)24.1
MATH-500 (Artificial Analysis source)73.7
MMLU Pro70.3
SciCode (Artificial Analysis)29.5
Loading Atlas data…