Marie-Catherine de Marneffe

Label and Explanation Variation in LLM-Based Annotation: a Case Study in Natural Language Inference

Large language models (LLMs) have shown considerable promise for annotation purposes, yet questions remain about their ability to capture human label variation (HLV) — genuine disagreement between annotators often observed across NLP tasks. Here, we investigate how label and explanation variation manifests within and a...