Concept Synth INDUCTION v1 - CI
General QA · 2026-05-23
The contrastive-induction split of INDUCTION v1. A formula must exactly match targets in YES worlds while deliberately failing to match at least one target in each contrastive NO world.
Top models (higher is better)
| Model | Score |
|---|---|
| GPT-5.2 | 82.5 |
| Opus 4.6 | 79.5 |
| GPT-5.4 | 79.0 |
| Gemini 3.5 Flash | 78.5 |
| Grok 4 | 78.0 |
| Gemini 3.1 Pro Preview | 70.0 |
| DeepSeek-V4-Pro | 67.0 |
| Grok 4.1 Fast | 60.5 |
| Gemini 3 Pro Preview | 55.0 |
| Grok 4.3 | 46.0 |
| DeepSeek-V3.2 | 41.7 |
| Opus 4.5 | 34.0 |
| GPT-4o | 0.5 |