Weijie J. Su

Statistical impossibility and possibility of aligning LLMs with human preferences: From Condorcet paradox to Nash equilibrium

Aligning large language models (LLMs) with diverse human preferences is critical for ensuring fairness and informed outcomes when deploying these models for decision-making. In this paper, we seek to uncover fundamental statistical limits concerning aligning LLMs with human preferences, with a focus on the probabilisti...