LiveCodeBench Pro
Code · 2025-06-13
LiveCodeBench Pro rates models on competitive-programming problems drawn from Codeforces, ICPC, and IOI contests, captured before editorials or accepted solutions are published. Ratings are Codeforces-scale Elo, recomputed against the original contest standings with a model's penalty time set to the human median. It is a separate benchmark from LiveCodeBench, which reports pass@1 accuracy.