← All benchmarks

LSCBench

Code · 2026-10-10

450 secure-coding tasks (Last Secure Code Benchmark) from the National University of Singapore and Alibaba's Qwen team: 150 vulnerability scenarios covering 24 CWEs, each posed at function, file and repository granularity. Each task asks a coding agent, offline in a Harbor container, to implement a functional specification derived from a real CVE in C, C++, Go, Java, JavaScript, PHP or Python; the specification never mentions security. Hidden functional tests and a security suite that replays the original attack run in a separate verifier, and a task counts only when both pass. The score (FUNC∧SEC) is the percentage of the 450 tasks whose code both works and is secure.

Top models (higher is better)