Llama 3 70B
Meta · 2024-04-18 · 70.6B parameters
Llama 3 70B is Meta's 70-billion-parameter pretrained base language model from the Llama 3 family, released in April 2024. It features improved reasoning and coding capabilities over Llama 2, an 8K-token context window, and a significantly expanded vocabulary, serving as the base checkpoint for the Llama 3 70B Instruct model.
Benchmark scores
| Benchmark | Score |
|---|---|
| Epoch Capabilities Index (ECI) | 122 |
| ForecastBench Tournament Overall Brier Index | 57.1 |
| OSWorld (self-reported, A11y tree) | 1.6 |
| WinoGrande | 83.5 |