Human vs LLM in Conversational Repair Annotation: A New Resource and Comparative Study
This work introduces OIR annotations for the NOXI corpus, achieving considerable reliability and evaluating whether LLMs can reliably annotate OIR sequences using structured Chain-of-Thought prompting and comparative analysis across two corpora, finding weak alignment between LLMs and human annotations, particularly in...