Korean
General QA · 2024-06-01
Scale SEAL's Korean evaluation uses 1,000 prompts written for Korean speakers, with culturally fluent expert annotators assessing each response three times in parallel. Grading combines point-wise rubric scores with pairwise preferences on a seven-point Likert scale, aggregated into an Elo-style rating with confidence intervals.