Models

← All models

PaLM 2-S

Google DeepMind · 2023-05-10

PaLM 2-S is the Small variant among the three PaLM 2 sizes evaluated in Google's technical report. It is a text-input, text-output Transformer pretrained on a larger, more multilingual and diverse corpus than PaLM with a mixture of objectives; the report evaluates it across language, reasoning, and natural-language-generation tasks, while treating the code-heavy PaLM 2-S* as a separate continued-training variant. Google withholds PaLM 2-S's parameter count and detailed architecture.

Benchmark scores