This talk presents case studies in which evaluation metrics reward surface-level improvements like polish and fluency while overlooking evidentiary content, correctness, and editorial usefulness, and discusses practical lessons for building reliable evaluation systems in real peer review workflows.
Negar Arabzadeh, Sajad Ebrahimi, Shakiba Amirshahi et al.· Proceedings of the 35th ACM...· 0 citations
Reviewerly's retrieval-centered infrastructure for auditing peer review at scale is presented and three deployed systems are described, including three deployed systems that analyzes hybrid human--AI authorship by disentangling the origin of ideas from the origin of text in peer reviews, enabling measurement of how hum...
Negar Arabzadeh, Sajad Ebrahimi, Alireza Daghighfarsoodeh et al.· Annual International ACM SIG...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.