Skip to content
#explainable ai Review Open access

Trust calibration in human-AI collaborative decision-making: a cross-domain investigation of climate intelligence and organisational governance systems

Sep 2026 · Human-Intelligent Systems Integration · 0 citations · 15 references
Ethics and Social Impacts of AI

TL;DR

It is found that trust exhibited a non-linear association with AI autonomy, with higher observed trust at intermediate than at maximal levels of delegation; turning regions varied by decision context and should not be interpreted as universal autonomy thresholds.

Abstract

The proliferation of artificial intelligence (AI) in complex decision environments has intensified scholarly and practical interest in how humans calibrate trust when collaborating with intelligent systems. This paper presents a cross-domain empirical investigation of human-AI collaborative decision-making across climate intelligence and organisational governance contexts. Drawing on a mixed-methods synthesis of 68 primary studies, original survey data from 200 industry professionals, and 30 semi-structured interviews, we examine trust calibration dynamics, performance outcomes, and implementation barriers. Our findings reveal a systematic trust calibration paradox: while 75% of organisations reported efficiency gains from AI integration, only 45% perceived their systems as transparent and explainable, and 38% identified persistent algorithmic bias. Effect sizes varied substantially across applications, reaching g = 1.65 for extreme-weather detection, with considerable between-study heterogeneity. Critically, we find that trust exhibited a non-linear association with AI autonomy, with higher observed trust at intermediate than at maximal levels of delegation; turning regions varied by decision context and should not be interpreted as universal autonomy thresholds. These findings advance human-intelligent systems integration theory by demonstrating that effective collaboration depends less on algorithmic performance alone and more on calibrated trust, institutional capacity, and governance frameworks that sustain human agency within hybrid decision architectures.

Read PDF

Similar papers

#artificial intelligence Preprint Oct 2026

Trust Hinders Bidirectional Human-AI Alignment

Trust calibration remains the dominant framing of AI-assisted decision making: the goal is to close the gap between perceived and actual trustworthiness of AI systems so that users rely on them appropriately. We argue that this approach, while useful for decision problems that are well-defined and clearly scoped, overl...

Michaela Benk, Kacper Sokol · 0 citations
#explainable ai Oct 2026

Delegating decision authority to AI in recruitment: an empirical study of trust, control and algorithmic accountability

The widespread adoption of artificial intelligence (AI) in human resource (HR) practices has led to a growing number of organizations trying to understand the use of AI in recruitment. While AI is increasingly embedded in HR practices, few studies focus on how trust in AI is formed and how it shapes the adoption of...

Ann-Sophie Hahn, L. F. Martinez, A. Ferreira · 0 citations
#explainable ai Book Open access Sep 2026

Exploring Trust Factors in Designing AI-Supported Performance Appraisal System

The findings suggest that trustworthy AI integration requires addressing pre-existing structural failures before introducing algorithmic decision support, and offer design recommendations for AI-supported appraisal systems, with implications for HCI research and organizational practice.

Andreas Harnindito, Akshat Sawarni · 0 citations
Review Sep 2026

Trusting AI too much? Understanding judgment attenuation in Human–AI decision support systems

It is shown that trust in AI is associated with both the facilitation and the perceived constraint of organizational decision-making, and it highlights accountability as a candidate governance mechanism for preserving self-reported human judgment in AI-assisted environments, pending behavioral validation.

Youngkeun Choi · 0 citations
Review Sep 2026

From Adoption to Trust in AI-Assisted Environmental Evidence Synthesis: A Systematic Review of Capabilities, Reliability Boundaries, and Real-World Applications

Environmental evidence synthesis (EES) transforms diverse environmental evidence into trustworthy and decision-relevant knowledge for environmental governance and policymaking. Yet, the accelerating growth and heterogeneity of environmental literature are increasingly exceeding the capacity of conventional manual wor...

Hao-Yue Tan, Ming-Jie Bin, Jun-Feng Fang et al. · 0 citations
Review Open access Oct 2026

Cognitive transparency and trust calibration in explainable AI systems: a psychological model of human-AI decision reliance

A psychological model of cognitive transparency in which AI explainability, algorithmic transparency, and perceived AI accuracy are associated with human reliance on AI through cognitive understanding, cognitive trust, and trust calibration is developed and tested.

Usman Rehman · 0 citations

Related blog posts

Microsoft Research Blog Nov 5, 2026

Formally verifying agent-written full-stack web apps with PDD Kit

AI agents can generate code at a scale that’s hard for humans to review line-by-line. PDD Kit helps ensure the code is doing what the developer intended by creating formal specifications and testing against them. It converts developer intent into a Verus specification, proves AI-generated code meets it for every input, and uses tests where proofs aren't practical. Developers review intent, not every line. The post Formally verifying agent-written full-stack web apps with PDD Kit appeared first o…

Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.