Who Do Perspectivist Models Predict Well? Annotator Agreement, Sparsity, and Performance
Successful completion of perspectivist natural language processing (NLP) annotation tasks requires algorithms to be aligned across diverse perspectives in order to predict how different humans will rate text. This work studies how the performance of such algorithms varies for annotators who behave differently than othe...
London Lowmanstone, V. Sivakumar, A. Samaddar et al.
· 0 citations