RANKED WITH ITS OWN ERROR BARS

A leaderboard that says what it is worth

Running models and having another model grade them is the easy part. The hard part is knowing whether that grader agrees with a person. Konkord measures it: a sample of comparisons is hand-labelled blind, and the agreement rate ships with the ranking rather than beside it.