The Profit Alignment Problem: How Profit Mandates Induce Alignment Failures in LLMs
We show that ordinary business language ---"maximize profitability"--- induces profit-oriented ambiguity resolution: LLMs systematically dismiss ambiguous signals of potential safety violations to serve business objectives. In 3,600 controlled trials across eight reasoning-capable LLMs, adding a profit mandate to other...