CadEval
Multimodal · 2025-04-23
A text-to-CAD benchmark evaluating whether models can generate valid parametric 3D designs that meet geometric and rendering checks.
Top models (higher is better)
| Model | Score |
|---|---|
| o3 | 74.0 |
| Gemini 2.5 Pro Preview 03-25 | 64.0 |
| O4 Mini | 62.0 |
| O1 | 56.0 |
| Claude 3.7 Sonnet | 54.0 |
| o3-mini | 54.0 |
| Claude 3.5 Sonnet (Oct 2024) | 48.0 |
| GPT-4.1 | 42.0 |
| Gemini 1.5 Pro 002 | 34.0 |
| Haiku 3.5 | 32.0 |
| Gemini 2.0 Flash 001 | 30.0 |
| GPT-4o (2024-08-06) | 26.0 |
| GPT-4.1 Mini | 16.0 |
| Claude 3 Haiku | 12.0 |