Code Migration v1.1 - COBOL
Code · 2026-10-19
The COBOL split of Code Migration v1.1: 10 COBOL-to-Java migrations (open-source COBOL programs and synthetic operational systems) stressing file formats, batch workflows, terminal interfaces and persistent state, run on the Pi harness and graded by revised hidden tests.
Top models (higher is better)
| Model | Score |
|---|---|
| Claude Sonnet 5.5 | 99.0 |
| GLM-5.3 | 98.5 |
| DeepSeek V4 Pro 0813 | 97.5 |
| GPT-6 Astra | 93.0 |
| Muse Wonder Full | 93.0 |
| DeepSeek V4.1 Flash 1017 | 92.5 |
| DeepSeek V4.1 Flash | 92.5 |
| Grok 4.7 | 91.2 |
| GLM-5.3 Flash | 90.5 |
| Muse Wonder | 88.0 |
| GPT-6.1 Sol | 85.0 |
| Claude Haiku 5.5 | 83.0 |
| Step 5 Preview | 82.5 |
| Kimi K3 | 80.0 |
| Gemini 4 Argon | 79.7 |
| MiMo-V2.6-Pro | 77.6 |
| MiMo-V2.6-Flash | 77.3 |
| Mercury 3 | 73.2 |
| Gemini 3.8 Flash | 71.7 |
| Hy4 Preview | 67.8 |
| Beam 1.0 501B A23B | 64.6 |
| Muse Spark Open | 62.5 |
| MiniMax M3 | 58.6 |
| GPT-6 Luna | 53.7 |
| Inkling-Small | 32.7 |
| Inkling | 27.4 |