Grok 1
xAI · 2024-03-17
Grok 1 is xAI's first-generation language model, released as open weights in March 2024 under Apache 2.0 as a base (pretrained, non-instruction-tuned) checkpoint. xAI describes it as a 314B-class mixture-of-experts model with 25% of its weights active for a given token, but does not publish exact total or active parameter counts. The checkpoint was originally trained in JAX.
Benchmark scores
| Benchmark | Score |
|---|---|
| Artificial Analysis Intelligence Index | 6.0 |
| Capability | 109.3 |
| GSM8K | 62.9 |
| HumanEval | 63.2 |
| MATH | 23.9 |
| MMLU | 73.0 |