PaLM 2-M
Google DeepMind · 2023-05-10
PaLM 2-M is the medium variant of Google's PaLM 2 family evaluated in the May 2023 technical report. It is a Transformer-based text language model trained with a tuned mixture of pre-training objectives on a multilingual corpus spanning web documents, books, code, mathematics, conversational data, and parallel text. Google withholds the model's parameter count and detailed architecture; in the report's one-shot English QA and classification comparison, PaLM 2-M consistently outperforms PaLM 540B.
Benchmark scores
| Benchmark | Score |
|---|---|
| ARC AI2 | 64.9 |
| BoolQ | 88.6 |
| Capability | 110.0 |
| Epoch Capabilities Index (ECI) | 107 |
| HellaSwag (Unspecified Scoring Protocol) | 84.0 |
| OpenBookQA | 57.4 |
| TriviaQA | 81.7 |
| WinoGrande | 79.2 |