Gemma 2 9B
Google DeepMind · 2024-06-27 · 9.2B parameters
Gemma 2 9B is Google DeepMind's text-to-text, decoder-only, open-weight pre-trained model in the Gemma 2 family. Trained on 8 trillion primarily English tokens using knowledge distillation from a larger teacher, it alternates 4,096-token local sliding-window attention with 8,192-token global attention.