Gemma 2B
Google DeepMind · 2024-02-21 · 2.5B parameters
Gemma 2B is the base (pretrained, not instruction-tuned) 2B checkpoint of Google's original Gemma family, released alongside Gemma 7B in February 2024. It is a text-to-text, decoder-only Transformer with multi-query attention, an 8,192-token context, and a SentencePiece tokenizer, trained primarily on English web documents, mathematics, and code. At roughly 2.5 billion parameters, it targets CPU, laptop, and other resource-constrained or on-device deployments; the separate gemma-2b-it checkpoint is the instruction-tuned variant.