N. Prokopyev

PromptAlign: Automatic Iterative Alignment of a Large Language Model to Expert Annotations without Fine-Tuning

Large language models are increasingly used in social and psychological sciences; however, their predictions are systematically biased relative to expert annotations (alignment shift), and attempts to manually refine instructions or to supply examples lead to a “blanket-pulling” effect – degradation of minority classes...