LisanBench Path Length
Games · 2025-05-30
LisanBench Path Length sums each model's valid edit-distance-one word-chain transitions across 50 starting words after averaging the three trials for each word. Chains must begin with the required word, use dictionary words, and never repeat a word.
Top models (higher is better)
| Model | Score |
|---|---|
| Claude Opus 5 | 15428 |
| Opus 4.7 | 14400 |
| Opus 4.6 | 14206 |
| Claude Fable 5 | 13680 |
| Sonnet 4.6 | 12060 |
| Kimi K3 | 10521 |
| GPT-5.5 | 9845 |
| Opus 4.8 | 9463 |
| Gemini 3.1 Pro Preview | 6445 |
| Sonnet 5 | 5724 |
| Opus 4.5 | 5513 |
| GPT-5.4 | 5335 |
| DeepSeek-V3.2-Speciale | 5073 |
| GPT-5.6 Sol | 4699 |
| Gemini 3 Pro Preview | 4677 |
| Gemini 3.5 Flash | 4123 |
| Grok 4 | 4042 |
| Grok 4.20 | 3856 |
| GPT-5.2 | 3592 |
| o3 | 3309 |
| GPT-5.6 Terra | 3303 |
| DeepSeek-V4-Pro | 3256 |
| DeepSeek-V4-Flash | 2789 |
| Grok 4 Fast | 2750 |
| Sonnet 4.5 | 2665 |
| Step 3.5 Flash | 2410 |
| DeepSeek-V3.2 | 2348 |
| GPT-5 | 2247 |
| Sonnet 4 | 2236 |
| GPT-5.6 Luna | 2105 |
| Kimi K2 Thinking | 2002 |
| Gemini 3 Flash Preview | 1996 |
| Kimi K2.5 | 1852 |
| GLM-5.2 | 1835 |
| Grok 4.1 Fast | 1817 |
| Doubao Seed 2.0 Pro | 1753 |
| GPT-5 Mini | 1562 |
| GPT-5.4 Nano | 1426 |
| o3-mini | 1366 |
| Qwen3.5 397B A17B | 1293 |