Atlas

Models

← All models

Llama 2 70B

Meta · 2023-07-18 · 69B parameters

Llama 2 70B is Meta's 70-billion-parameter pretrained base language model from the Llama 2 family, released in July 2023. It was trained on 2 trillion tokens of publicly available data with a context length of 4,096 tokens, serving as the base checkpoint for the Llama 2 70B Chat model.

Benchmark scores

BenchmarkScore
BBH (Open LLM Leaderboard v2)54.7
Capability108.8
CommonSenseQA 250.0
Epoch Capabilities Index (ECI)113
GPQA (Open LLM Leaderboard v2)30.3
HellaSwag (Unspecified Scoring Protocol)85.3
IFEval (Open LLM Leaderboard v2)24.1
LAMBADA78.9
LegalBench62.4
LegalBench - Conclusion Tasks73.2
LegalBench - Interpretation Tasks58.3
LegalBench - Issue Tasks53.9
LegalBench - Rhetoric Tasks64.5
LegalBench - Rule Tasks62.3
MATH Level 5 (Open LLM Leaderboard v2)3.2
MMLU-Pro (Open LLM Leaderboard v2)37.2
MuSR (Open LLM Leaderboard v2)41.2
OpenBookQA60.2
WinoGrande80.2
Loading Atlas data…