Diego Mardian

Demographic Injection in Medical Language Models under Diversity, Equity, and Inclusion Prompts

A side effect that misrepresents patients is measured: a one-sentence DEI prompt appended to a medical question leads models to add patient demographic attributes the question never stated, in effect rewriting who the patient is.