Skip to content

Designing for disagreement: epistemic friction, sycophancy, and the ethics of human–AI advice—a critical integrative review

Sep 2026 · AI and Ethics · Vol 6 · 0 citations · 33 references

TL;DR

This critical integrative review synthesizes research on automation bias, algorithm appreciation and aversion, large-language-model sycophancy, persuasive dialogue, anthropomorphic interaction, explainable AI, and human autonomy to reposition productive disagreement as a positive safety and autonomy property of human–AI systems.

View source

Similar papers

Open access Sep 2026

Why We Need Epistemically, Not Morally, Trustworthy AI: Decision Support and the Need for Collective Accountability

It is argued that once moral trustworthiness is set aside, the central normative question shifts from whether AI systems can be trusted to how their epistemic influence on human decision-making ought to be justified and governed.

John Dorsch, Maximilian Moll, Ophélia Deroy · 0 citations
Open access Sep 2026

AI-Mediated Ethical Communication: Epistemic Totalization the Fabricatable Zone and the Governmental Chain of Custody as Terminus

Large language models and AI-mediated search systems have become the primary intermediaries for institutional information across educational, legal, civic, and professional life. Current models of AI ethics focus primarily on the accuracy, bias, and fairness of AI systems. This focus is essential but fails to recognize...

Jonathan D. Nelson · 0 citations
#human-computer interacti... Preprint Sep 2026

Trust by Design: Trust Calibration Through Non-Advisory Socratic Dialogue in Conversational Agents

As conversational AI systems increasingly operate in sensitive domains, the central challenge shifts from usability to trust calibration, ensuring that users rely on systems neither too much nor too little. Systems that provide advice or interpretations risk encouraging inappropriate reliance, particularly when users p...

R. Hassan, Nahla Aboromi, Naomi Unkelos-Shpigel · 0 citations
#generative ai Open access Sep 2026

Simulated Morality, Misplaced Trust: The Risks of Treating AI as a Moral Partner

The article argues that many contemporary AI alignment practices risk a mistaken assimilation of moral agency to statistical learning. Techniques such as reinforcement learning from human feedback and constitutional AI often treat morality as a behavioral function that can be approximated from human discourse, behavior...

Saša Josifović · 0 citations
Aug 2026

The Illusion of Understanding: Generative AI, Epistemic Humility, and the Erosion of Intellectual Character

It is argued that intelligence should be assessed not by output quality or efficiency alone, but by its impact on intellectual character, arguing that intelligence should be assessed not by output quality or efficiency alone, but by its impact on intellectual character.

Dylan S. Bailey · 0 citations
Open access Sep 2026

Does AI undermine democratic deliberation? How engagement algorithms hijack epistemic agency

Does artificial intelligence (AI) threaten deliberative democracy? This paper argues that it does, not because it isolates citizens in simplistic “filter bubbles” understood as ideologically homogeneous silos, but because it hijacks the capacities through which beliefs are evaluated. While early accounts emphasized alg...

John Dorsch, Mark Coeckelbergh, Tillmann Vierkant · 0 citations

Related blog posts

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.