Jia-He Sui

When the Audit Depends on the Auditor: Prompt Sensitivity in Matched-Pair Audits of Large Language Models

Bias audits of large language models (LLMs) typically use a single prompt to compare model responses to identity-matched stimuli. This design rests on the implicit assumption that the estimated identity gap is stable across plausible prompt wordings. We test this assumption in a factorial experiment on three contempora...