Skip to content
Review Open access

Seeing inside the black box: Effects of algorithmic knowledge on system trustworthiness in aviation.

Oct 2026 · Ergonomics · pp. 1-16 · 0 citations · 41 references
Medicine

TL;DR

It is found that providing pilots with timely, clear information about AI processes modestly improves trust and supports calibrated reliance in an AI-based cockpit assistant.

Abstract

Automation has shaped aircraft design for the past seven decades, moving from fully manual control to highly automated systems. Despite this, pilots retain final authority for safety-critical decisions, which requires continuous trust calibration. This study investigated how algorithmic transparency influences pilots' learned trust in an AI-based cockpit assistant. Twenty-one commercial pilots were randomly assigned to an early transparency condition (detailed explanations of the AI's algorithms and performance provided before the tutorial) or a late transparency condition (the same information delivered after the experiment). Each pilot used the assistant during a tutorial and a realistic simulated flight. Mixed-effects ordinal models showed higher trust ratings for the early compared to the late transparency group during both tutorial and flight, and a larger trust increase between phases. In conclusion, providing pilots with timely, clear information about AI processes modestly improves trust and supports calibrated reliance.

Read PDF

Similar papers

CRiDiT: Instantiating a run-time testbed for trust calibration in AI-infused systems

CRiDiT (Computational Risk-Sensitive biDirectional Trust) is instantiated as a run-time testbed, operationalising machine-side trust with Dempster-Shafer Theory and PCR5 redistribution, human-side trust with Subjective Logic, and calibration with a threshold-based trust gap.

Yun-Tian Ding, Nicolas Herbaut, C. Salinesi · 0 citations
Oct 2026

Predictions in a Noisy Environment: The Influence of Automation Reliability and Transparency on User Trust

This study examined the potential interaction between automation reliability and automation transparency in the context of a weather-related decision to close a school in the face of a forecast blizzard. Participants received snowfall and closure advice from four different weather services dependent upon an automation...

H. L. Short, C. Wickens, J. Witt · 0 citations
Preprint Oct 2026

From Trust-by-Design to Continuous Trust in the Era of Artificial Intelligence

Trust is crucial in the digital world, particularly in the age of systems based on artificial intelligence. Traditionally, system correctness is demonstrated by proving that the system satisfies the required properties. However, digital systems involve humans, who can make mistakes, break rules, or even intentionally c...

P. Fettke, W. Reisig · 0 citations
Oct 2026

Human-Software Trust Over 45 Days of Simulated Spaceflight

Spaceflight operations are a dynamic, safety-critical environment that relies on automated systems. Crew are expected to trust systems throughout the missions. Within the spaceflight context, it remains unclear how trust in software changes over time, and how measures of trust relate to measures of usability. This stud...

Shivang Shelat, Katherine E. Homer, John A. Karasinski et al. · 0 citations
Review Oct 2026

Designing the Engineering Environment, Not Just the Engineer: Cognitive Foundations for Sustainable Systems Engineering Practice

Why do systems engineering practices degrade under pressure, and can the working environment be designed to prevent it? People attend to the signals they trust, and trust follows feedback. A delivery deadline offers clear criteria and immediate consequences, while a skipped review may cause no visible problem for month...

Roar Elias Georgsen · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.