Name: Claude 3.5 Sonnet (June 2024)
Author: Anthropic

Claude 3.5 Sonnet (June 2024)

Anthropic · 2024-06-20

Claude 3.5 Sonnet (June 2024) is the first Claude 3.5 Sonnet release, a mid-tier multimodal model that delivered a major intelligence gain over Claude 3 Sonnet while retaining Sonnet-class speed and cost.

Benchmark scores

Benchmark	Score
Adversarial Robustness	16.0
Agentic Tool Use (Chat)	56.1
Agentic Tool Use (Enterprise)	59.4
AidanBench	1361
Arabic	995
Arena Text — Business, Management & Financial Ops (No Style Control)	1235
Arena Text — Chinese (No Style Control)	1264
Arena Text — Creative Writing (No Style Control)	1239
Arena Text — English (No Style Control)	1288
Arena Text — Entertainment, Sports & Media (No Style Control)	1239
Arena Text — Exclude Ties (No Style Control)	1206
Arena Text — Exclude Ties (Style Controlled)	1296
Arena Text — Expert (No Style Control)	1246
Arena Text — French (No Style Control)	1292
Arena Text — French (Style Controlled)	1362
Arena Text — German (No Style Control)	1271
Arena Text — Hard Prompts (No Style Control)	1276
Arena Text — Hard Prompts English (No Style Control)	1284
Arena Text — Instruction Following (No Style Control)	1270
Arena Text — Japanese (No Style Control)	1231
Arena Text — Korean (No Style Control)	1200
Arena Text — Legal & Government (No Style Control)	1266
Arena Text — Life, Physical & Social Science (No Style Control)	1270
Arena Text — Longer Query (No Style Control)	1275
Arena Text — Medicine & Healthcare (No Style Control)	1244
Arena Text — Multi-turn (No Style Control)	1299
Arena Text — Non-English (No Style Control)	1270
Arena Text — Non-English (Style Controlled)	1332
Arena Text — Occupational Mathematical (No Style Control)	1294
Arena Text — Polish (No Style Control)	1327