The Reward Model Selection Crisis in Personalized Alignment
The findings reveal that the field has been optimizing for proxy metrics that do not predict deployment performance, and that current personalized alignment methods fail to operationalize preferences into behavioral adaptation under realistic deployment constraints, and finds simple in-context learning (ICL) to be high...