RegretBench (normalized regret)
General QA · 2026-07-24
RegretBench's primary policy metric on the open-domain QA subset: the whole-dialogue reward lost relative to the benchmark's reference clarification planner, divided by the planner's margin over the best immediate-answer baseline. Zero matches the reference planner, one matches answering immediately, and values above one are worse than not clarifying.