PaLM 2-S
Google DeepMind · 2023-05-10
PaLM 2-S is the Small variant among the three PaLM 2 sizes evaluated in Google's technical report. It is a text-input, text-output Transformer pretrained on a larger, more multilingual and diverse corpus than PaLM with a mixture of objectives; the report evaluates it across language, reasoning, and natural-language-generation tasks, while treating the code-heavy PaLM 2-S* as a separate continued-training variant. Google withholds PaLM 2-S's parameter count and detailed architecture.
Benchmark scores
| Benchmark | Score |
|---|---|
| ARC AI2 | 59.6 |
| BoolQ | 88.1 |
| Capability | 109.2 |
| Epoch Capabilities Index (ECI) | 105 |
| HellaSwag (Unspecified Scoring Protocol) | 82.0 |
| TriviaQA | 75.2 |
| WinoGrande | 77.9 |