Who Annotates in NLP? A Large-scale Assessment of Human Annotation Reporting between 2018 and 2025
The results show that annotation reporting in NLP has improved over time but remains uneven, and they establish a scalable framework and bare-minimum reporting recommendations for making human annotation more reliable, reproducible, and interpretable.