FeatureArc (first stage)
Code · 2026-10-27
The share of the 73 FeatureArc tasks whose first stage, implemented from the initial repository state, passes both its hidden fail-to-pass and pass-to-pass suites, in percent. It is equivalent to a single-stage feature task, run in the same persistent sessions and budget as the whole-feature chain gate.
Top models (higher is better)
| Model | Score |
|---|---|
| Claude Opus 5.5 | 83.6 |
| GPT-6 Astra | 67.1 |
| GLM-5.3 | 64.4 |
| Gemini 3.8 Flash | 61.6 |
| Grok 4.7 | 60.3 |
| Kimi K3 | 56.2 |
| DeepSeek V4 Pro 0813 | 52.1 |