Atlas

Models

← All models

Gemma 2 9B IT

Google DeepMind · 2024-06-27 · 9.2B parameters

Gemma 2 9B IT is the instruction-tuned 9-billion-parameter checkpoint from Google's Gemma 2 family. It fine-tunes Gemma 2 9B for chat and instruction-following workloads and is distributed as an open-weight Gemma model.

Benchmark scores

BenchmarkScore
AidanBench843
Arena Text — Business, Management & Financial Ops (No Style Control)1190
Arena Text — Chinese (No Style Control)1184
Arena Text — Creative Writing (No Style Control)1206
Arena Text — English (No Style Control)1220
Arena Text — Entertainment, Sports & Media (No Style Control)1185
Arena Text — Exclude Ties (No Style Control)1091
Arena Text — Exclude Ties (Style Controlled)1173
Arena Text — Expert (No Style Control)1147
Arena Text — French (No Style Control)1189
Arena Text — French (Style Controlled)1259
Arena Text — German (No Style Control)1186
Arena Text — Hard Prompts (No Style Control)1172
Arena Text — Hard Prompts English (No Style Control)1180
Arena Text — Instruction Following (No Style Control)1179
Arena Text — Japanese (No Style Control)1145
Arena Text — Korean (No Style Control)1137
Arena Text — Legal & Government (No Style Control)1215
Arena Text — Life, Physical & Social Science (No Style Control)1204
Arena Text — Longer Query (No Style Control)1197
Arena Text — Medicine & Healthcare (No Style Control)1165
Arena Text — Multi-turn (No Style Control)1193
Arena Text — Non-English (No Style Control)1188
Arena Text — Non-English (Style Controlled)1246
Arena Text — Occupational Mathematical (No Style Control)1193
Arena Text — Russian (No Style Control)1200
Arena Text — Software & IT Services (No Style Control)1198
Arena Text — Spanish (No Style Control)1199
Arena Text — Writing, Literature & Language (No Style Control)1219
BBH (Open LLM Leaderboard v2)59.9
Loading Atlas data…