Irem Ecem Yelkanat

Decomposing and Predicting Annotation Disagreement in Harmful Content Across Languages

Annotator disagreement is increasingly recognized as a meaningful property of subjective tasks, rather than merely noise to be removed. Predicting which items are likely to be contested could help allocate annotation effort and route difficult cases to human review. We propose predicting disagreement from interpretable...