← All benchmarks

ViBench 2.0

Code

Replit's ViBench 2.0 measures vibe coding: from an empty project, a coding agent builds one of 17 real-world web apps (8 public, 9 held out) one feature at a time from short product specs, choosing its own stack, in Replit's builder harness on the OpenHands SDK. A grading agent uses each finished app in a browser and follows its test plans step by step. The score is pass@1, the share of app builds in which every test plan passes, averaged over four builds per app and then over apps.

Top models (higher is better)