HellaSwag (Unspecified Scoring Protocol)
General QA · 2019-05-19
HellaSwag results for which the reporting source does not establish whether raw or length-normalized multiple-choice scoring was used. Values are retained as reported but quarantined from protocol-specific comparisons.
Top models (higher is better)
| Model | Score |
|---|---|
| Opus 3 | 95.4 |
| GPT-4 | 95.3 |
| Gemini 1.5 Pro | 93.3 |
| Claude 3 Sonnet | 89.0 |
| Gemini 1.0 Ultra | 87.8 |
| PaLM 2-L | 86.8 |
| Gemini 1.5 Flash | 86.5 |
| Claude 3 Haiku | 85.9 |
| Gemini 1.0 Pro | 84.7 |