Name: ChatGLM2 6B (chat)
Author: Zhipu AI (Z.ai)

ChatGLM2 6B (chat)

Zhipu AI (Z.ai) · 2023-06-25 · 6.2B parameters

ChatGLM2-6B-Chat is the chat-aligned/instruction-tuned variant of Zhipu AI's ChatGLM2-6B model, distinct from the pretrained base checkpoint.

Benchmark	Score
ARC AI2	61.0
Arena Text — Business, Management & Financial Ops (No Style Control)	887
Arena Text — Creative Writing (No Style Control)	942
Arena Text — English (No Style Control)	974
Arena Text — Entertainment, Sports & Media (No Style Control)	922
Arena Text — Exclude Ties (No Style Control)	685
Arena Text — Exclude Ties (Style Controlled)	802
Arena Text — Hard Prompts (No Style Control)	917
Arena Text — Hard Prompts English (No Style Control)	941
Arena Text — Instruction Following (No Style Control)	903
Arena Text — Life, Physical & Social Science (No Style Control)	916
Arena Text — Multi-turn (No Style Control)	902
Arena Text — Non-English (No Style Control)	857
Arena Text — Non-English (Style Controlled)	948
Arena Text — Software & IT Services (No Style Control)	918
Arena Text — Writing, Literature & Language (No Style Control)	953
BoolQ	79.0
Capability	81.8
Epoch Capabilities Index (ECI)	97.5
HellaSwag (Unspecified Scoring Protocol)	57.0
LAMBADA	54.3
LMArena Text Arena Coding Elo	1030
LMArena Text Arena Creative Writing Elo	1004
LMArena Text Arena Elo	1024
LMArena Text Arena English Elo	1056
LMArena Text Arena Hard Prompts Elo	1028
LMArena Text Arena Hard Prompts English Elo	1048
LMArena Text Arena Industry: Writing, Literature & Language Elo	1015
LMArena Text Arena Instruction Following Elo	982
LMArena Text Arena Math Elo	972