Benchmarks

← All benchmarks

Vibe Code Bench 1–100

Code · 2026-09-22

Fifty held-out web-development scenarios with up to ten dependent feature requests and a shared ten-hour budget per scenario. Modified OpenHands v1 agent uses Supabase, Stripe and MailHog services. Score is the mean fraction of planned consecutive iterations completed perfectly before the first failure; it is not binary task accuracy. Fifty validation scenarios are excluded.

Top models (higher is better)