Ethical Decision-Making in the Workplace: Which Factors Influence Decision-Makers' Willingness to Revise Their Decisions due to AI-Generated Suggestions?
ObjectiveTo examine how moral intensity and perceived trustworthiness of an AI certifier influence individuals' willingness to change their decision due to AI-generated suggestions.BackgroundAI-supported decision-making is increasingly used in professional contexts and situations with a high moral intensity. Yet it is unclear how different factors influence the willingness to base decisions on AI-generated suggestions in such situations. Perceived trustworthiness in the AI system is key for effective and ethically sound deployment. Investigating the interplay of these factors is critical for understanding AI-supported ethical decision-making and designing AI systems that support responsible decision-making in morally complex workplace environments.MethodWe conducted a 2 × 2 vignette-based online experiment with a representative US sample (n = 546), manipulating moral intensity and AI certifier trustworthiness. Participants made an initial workplace decision (whom to let go), received a deviating AI suggestion, and then made a second decision. Effects of independent and control variables on decision changes were analyzed using hierarchical logistic regression and χ2-tests.ResultsDecision makers were more likely to change decisions in high moral intensity scenarios due to AI suggestions. Certifier trustworthiness had no significant effect, whereas a positive general attitude towards AI increased the likelihood of changing decisions, suggesting that overall, AI attitude may overshadow perceived certifier trustworthiness.ConclusionHuman factors play a more prominent role than AI certifications when it comes to trust-building in AI suggestions for ethical decision-making in the workplace. Further research is needed to clarify how these factors interact with perceived certifier trustworthiness and other contextual factors.ApplicationEncouraging reliance on AI-based recommendations via certifications alone is challenging. Organizations should focus on their employees' general attitudes towards AI to support AI-based ethical decision-making in the workplace. AI systems could play a significant supporting role particularly in decision situations with high moral intensity.