SnorkelManufacturing
Professional Work
Pass@1 on 200 simulated discrete-parts manufacturing tasks combining CAD reasoning, engineering evidence, production and quality decisions, safety constraints and controlled state changes. Native effort and agent scaffold are not disclosed.
Top models (higher is better)
| Model | Score |
|---|---|
| Grok 4.6 | 16.4 |
| Grok 4.7 | 12.1 |
| GLM-5.3 | 11.9 |
| Claude Fable 5.1 | 11.3 |
| Muse Spark 1.3 | 10.5 |
| Claude Opus 5.5 | 10.4 |
| Kimi K3 | 10.2 |
| GPT-6 Astra | 10.0 |
| Claude Opus 5 | 9.4 |
| Gemini 3.8 Flash | 7.1 |