Ethical Decision-Making in the Workplace: Which Factors Influence Decision-Makers' Willingness to Revise Their Decisions due to AI-Generated Suggestions?
TL;DR
Human factors play a more prominent role than AI certifications when it comes to trust-building in AI suggestions for ethical decision-making in the workplace, suggesting that overall, AI attitude may overshadow perceived certifier trustworthiness.
Abstract
ObjectiveTo examine how moral intensity and perceived trustworthiness of an AI certifier influence individuals' willingness to change their decision due to AI-generated suggestions.BackgroundAI-supported decision-making is increasingly used in professional contexts and situations with a high moral intensity. Yet it is unclear how different factors influence the willingness to base decisions on AI-generated suggestions in such situations. Perceived trustworthiness in the AI system is key for effective and ethically sound deployment. Investigating the interplay of these factors is critical for understanding AI-supported ethical decision-making and designing AI systems that support responsible decision-making in morally complex workplace environments.MethodWe conducted a 2 × 2 vignette-based online experiment with a representative US sample (n = 546), manipulating moral intensity and AI certifier trustworthiness. Participants made an initial workplace decision (whom to let go), received a deviating AI suggestion, and then made a second decision. Effects of independent and control variables on decision changes were analyzed using hierarchical logistic regression and χ2-tests.ResultsDecision makers were more likely to change decisions in high moral intensity scenarios due to AI suggestions. Certifier trustworthiness had no significant effect, whereas a positive general attitude towards AI increased the likelihood of changing decisions, suggesting that overall, AI attitude may overshadow perceived certifier trustworthiness.ConclusionHuman factors play a more prominent role than AI certifications when it comes to trust-building in AI suggestions for ethical decision-making in the workplace. Further research is needed to clarify how these factors interact with perceived certifier trustworthiness and other contextual factors.ApplicationEncouraging reliance on AI-based recommendations via certifications alone is challenging. Organizations should focus on their employees' general attitudes towards AI to support AI-based ethical decision-making in the workplace. AI systems could play a significant supporting role particularly in decision situations with high moral intensity.