← All benchmarks

ProgramBench - almost solved rollout percentage

Code

Percentage of clean-room program reconstruction rollouts passing at least 95% of hidden behavioral tests. This is a rollout success percentage, distinct from mean utility and absolute solved counts; repeated-trial aggregation and task denominator are source-specific.

Top models (higher is better)