Alignment by Stereotyping: How LLMs Sacrifice Individual Distinctiveness for Cultural Adaptation
Large language models are increasingly deployed for personalized interaction, and demographic conditioning via user profiles is a widely adopted strategy for cultural adaptation. We ask whether this approach genuinely serves individual users or achieves accuracy by erasing individual distinctiveness. Studying seven mod...