Skip to content
#explainable ai Review Open access

Human-In-The-Loop Decision Systems: Advances and Future Directions

Sep 2026 · INTERNATIONAL JOURNAL OF SOCIAL SCIENCES AND MANAGEMENT RESEARCH · 0 citations
Explainable Artificial Intelligence (XAI)

TL;DR

It is argued that treating the human and the model as a single joint cognitive system is the central design principle for the next generation of decision systems.

Abstract

Human-in-the-loop (HITL) decision systems combine algorithmic inference with human judgment so that people supervise, correct, and complement automated components rather than being replaced by them. As machine learning is embedded in consequential decisions across finance, public administration, and security operations, the question is no longer whether to automate but how to allocate authority between people and machines so that the joint system outperforms either alone. This paper synthesizes advances in HITL decision systems and sets out a research agenda. We first clarify the HITL concept and situate it on the automation spectrum, drawing on classical models of levels of automation and function allocation. We then review four intersecting streams of progress: interaction paradigms and active learning that let people shape models efficiently; explanation and calibrated trust, where explainable AI and trust-calibration research aim to align reliance with actual system reliability; task allocation and adaptive autonomy grounded in mixed initiative interaction; and domain applications in financial analytics, digital public services, and operational risk and cybersecurity. A described taxonomy organizes recurring HITL patterns by the locus and timing of human involvement. We next examine open challenges, automation bias and algorithm aversion, cognitive load and vigilance decrement, diffuse accountability, and the immaturity of evaluation methods that measure joint human-AI performance rather than model accuracy alone. Finally, we propose a forward agenda emphasizing calibrated-reliance metrics, adaptive and learnable task allocation, human-centered explanation, sociotechnical accountability, and rigorous mixed-methods evaluation. We argue that treating the human and the model as a single joint cognitive system is the central design principle for the next generation of decision systems.

Read PDF

Similar papers

Open access Sep 2026

Balancing Trust and Deliberation in Human–AI Decision Support: The Effects of Explainable AI and Cognitive Forcing Functions

This work examines how six decision-support mechanisms affect engagement, trust, and collaborative task performance in a diabetes meal-planning scenario and argues for a contextual, balanced pairing of CFF and XAI design that accounts for interactivity, decision frequency, and task complexity.

Oliver Henderson · 0 citations
Review Open access Sep 2026

Harnessing Human Intelligence and Artificial Intelligence for Collaborative Problem Solving: a Framework for Enhanced Decision-making

A formal human-AI Collaborative Problem-Solving (HACPS) model is presented, which proposes and empirically tests five falsifiable and explicit statistical hypotheses for task partitioning of decision sub-tasks between human and machine agents based on their comparative strengths.

E. Abegunde · 0 citations
Review Open access Aug 2026

The Role of Generative Artificial Intelligence in Modern Business Decision-Making: Applications, Opportunities, and Future Challenges

GenAI's current business value is concentrated in augmenting, rather than automating, decision-making, with the strongest evidence for productivity gains among relatively lower-skilled or lower-performing decision-makers, and the mapping of AI capability boundaries within specific decision domains as the central future...

Rajidi Rammohan Reddy, V. Thumar, Amar Jyoti Borah et al. · 0 citations
Sep 2026

Responsibility to the Problem: An Explicit Standard for the Expert–AI System

Discussions of artificial intelligence in science ask who is responsible when AI produces an incorrect result. This question is vague unless it identifies the object of responsibility, evidence, decisions, and cognitive process. Public criticism often isolates an erroneous output while omitting the question, informatio...

Laboratory of Information Systems · 0 citations
Open access 2026

Human in the Loop Agentic Recruitment: Balancing Automation, Recruiter Productivity, and Decision Quality

It is concluded that effective agentic recruitment requires not maximum automation, but carefully designed human-AI collaboration that enhances productivity while maintaining fairness, transparency, accountability, and recruitment decision quality.

C. Butani · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.