GPT-3 XL
OpenAI · 2020-05-28
GPT-3 XL is OpenAI's approximately 1.3-billion-parameter GPT-3 base language model from the 2020 "Language Models are Few-Shot Learners" paper. It is a mid-sized dense autoregressive transformer in the published GPT-3 scaling series.
Benchmark scores
| Benchmark | Score |
|---|---|
| BoolQ | 57.4 |
| GSM8K | 0.7 |
| HellaSwag (Unspecified Scoring Protocol) | 55.5 |