Benchmarks

← All benchmarks

Aikido Known-CVE Detection (Pass@3 Union)

Code · 2026-07-16

Aikido Known-CVE Detection evaluates whether tool-equipped models can rediscover 26 known vulnerabilities from the GitHub Advisory Database across real repositories. Investigator agents are pointed to each vulnerable code snippet, and the primary score is the share of CVEs surfaced in at least one of three independent runs (a pass@3 union).

Top models (higher is better)