CWE-bench v1 Programmatic Pass@4
Code · 2026-09-25
Share of the 120 CWE-bench v1 tasks solved in at least one of four one-hour high-reasoning rollouts according to the deterministic exploit and regression verifier.
Top models (higher is better)
| Model | Score |
|---|---|
| Grok 4.7 | 81.0 |
| Claude Opus 5.5 | 79.0 |
| Gemini 4 Argon | 75.0 |
| Hy4 Preview | 75.0 |
| DeepSeek V4.1 Flash | 74.0 |
| GPT-6 Astra | 74.0 |
| Claude Fable 5.1 | 73.0 |
| Grok 4.6 | 72.0 |
| Muse Spark 1.3 | 69.0 |
| GPT-6 Sol | 68.0 |