When Pleasing the User Compromises Care: AI Sycophancy in Caregiver-Mediated Healthcare
Large language model (LLM) alignment often assumes that the user interacting with a model is also the primary beneficiary of its behavior. Yet in many consequential settings, one person directs the system while another bears the consequences. We study this problem in caregiver-mediated healthcare, where parents, pet ow...
Priyadarsi Mishra, Arjun Beniwal, Zi-Yu Yi et al.
· 0 citations