Name: Claude 3 Haiku
Author: Anthropic

Claude 3 Haiku

Anthropic · 2024-03-13

Claude 3 Haiku is Anthropic's fastest, most compact Claude 3 model for near-instant responsiveness and cost-sensitive enterprise workloads. It accepts text and image inputs, produces text, and was released with a 200K-token production context window.

Benchmark scores

Benchmark	Score
AA-LCR	21.0
AA-Omniscience Index	-47.6
AidanBench	218
ARC-Challenge	89.2
Arena Text — Business, Management & Financial Ops (No Style Control)	1157
Arena Text — Chinese (No Style Control)	1154
Arena Text — Creative Writing (No Style Control)	1158
Arena Text — English (No Style Control)	1206
Arena Text — Entertainment, Sports & Media (No Style Control)	1152
Arena Text — Exclude Ties (No Style Control)	1076
Arena Text — Exclude Ties (Style Controlled)	1171
Arena Text — Expert (No Style Control)	1147
Arena Text — French (No Style Control)	1193
Arena Text — French (Style Controlled)	1276
Arena Text — German (No Style Control)	1174
Arena Text — Hard Prompts (No Style Control)	1174
Arena Text — Hard Prompts English (No Style Control)	1183
Arena Text — Instruction Following (No Style Control)	1174
Arena Text — Japanese (No Style Control)	1103
Arena Text — Korean (No Style Control)	1109
Arena Text — Legal & Government (No Style Control)	1191
Arena Text — Life, Physical & Social Science (No Style Control)	1179
Arena Text — Longer Query (No Style Control)	1191
Arena Text — Medicine & Healthcare (No Style Control)	1164
Arena Text — Multi-turn (No Style Control)	1190
Arena Text — Non-English (No Style Control)	1177
Arena Text — Non-English (Style Controlled)	1246
Arena Text — Occupational Mathematical (No Style Control)	1187
Arena Text — Polish (No Style Control)	1232
Arena Text — Polish (Style Controlled)	1297