CRED v0.92 - Execution
Science · 2026-07-20
The CRED v0.92 execution chapter measures detection recall on failures recorded in the deterministic Replication and Build Defects diagnosis supplied to every verifier.
Top models (higher is better)
| Model | Score |
|---|---|
| GPT-4 Turbo | 100.0 |
| GPT-4o | 100.0 |
| GPT-4o Mini | 100.0 |
| Llama 3.3 70B Instruct | 100.0 |
| O1 | 100.0 |
| DeepSeek-R1 | 100.0 |
| Gemma 3 27B IT | 100.0 |
| DeepSeek-V3-0324 | 100.0 |
| Llama 4 Maverick Instruct | 100.0 |
| GPT-4.1 Nano | 100.0 |
| GPT-4.1 | 100.0 |
| Qwen3-235B-A22B | 100.0 |
| Opus 4 | 100.0 |
| DeepSeek-R1-0528 | 100.0 |
| Mistral Small 3.2 24B Instruct 2506 | 100.0 |
| Kimi K2 Instruct | 100.0 |
| Qwen3 235B A22B Instruct 2507 | 100.0 |
| GLM-4.5 | 100.0 |
| gpt-oss-120b | 100.0 |
| Opus 4.1 | 100.0 |
| DeepSeek-V3.1 | 100.0 |
| Sonnet 4.5 | 100.0 |
| GLM 4.6 | 100.0 |
| MiniMax M2 | 100.0 |
| Kimi K2 Thinking | 100.0 |
| Opus 4.5 | 100.0 |
| DeepSeek-V3.2 | 100.0 |
| Mistral Large 3 675B Instruct 2512 | 100.0 |
| GLM-4.7 | 100.0 |
| Kimi K2.5 | 100.0 |
| GLM-5 | 100.0 |
| Sonnet 4.6 | 100.0 |
| Nemotron 3 Super 120B A12B | 100.0 |
| Gemma 4 31B IT | 100.0 |
| Kimi K2.6 | 100.0 |
| GPT-5.5 | 100.0 |
| Hy3 preview | 100.0 |
| DeepSeek-V4-Flash | 100.0 |
| DeepSeek-V4-Pro | 100.0 |
| Ring 2.6 1T | 100.0 |