Atlas

Models

← All models

Gemma 2 27B IT

Google DeepMind · 2024-06-27 · 27.2B parameters

Gemma 2 27B IT is the instruction-tuned 27-billion-parameter checkpoint from Google's Gemma 2 family. It adapts the Gemma 2 27B base model for chat, instruction following, and assistant-style use while preserving the Gemma open-weight license.

Benchmark scores

BenchmarkScore
AidanBench1006
Arena Text — Business, Management & Financial Ops (No Style Control)1207
Arena Text — Chinese (No Style Control)1220
Arena Text — Creative Writing (No Style Control)1241
Arena Text — English (No Style Control)1242
Arena Text — Entertainment, Sports & Media (No Style Control)1213
Arena Text — Exclude Ties (No Style Control)1129
Arena Text — Exclude Ties (Style Controlled)1211
Arena Text — Expert (No Style Control)1171
Arena Text — French (No Style Control)1246
Arena Text — French (Style Controlled)1312
Arena Text — German (No Style Control)1209
Arena Text — Hard Prompts (No Style Control)1199
Arena Text — Hard Prompts English (No Style Control)1208
Arena Text — Instruction Following (No Style Control)1206
Arena Text — Japanese (No Style Control)1176
Arena Text — Korean (No Style Control)1174
Arena Text — Legal & Government (No Style Control)1241
Arena Text — Life, Physical & Social Science (No Style Control)1228
Arena Text — Longer Query (No Style Control)1231
Arena Text — Medicine & Healthcare (No Style Control)1197
Arena Text — Multi-turn (No Style Control)1224
Arena Text — Non-English (No Style Control)1217
Arena Text — Non-English (Style Controlled)1274
Arena Text — Occupational Mathematical (No Style Control)1221
Arena Text — Polish (No Style Control)1276
Arena Text — Polish (Style Controlled)1350
Arena Text — Russian (No Style Control)1233
Arena Text — Software & IT Services (No Style Control)1229
Arena Text — Spanish (No Style Control)1227
Loading Atlas data…