Skip to content

Truth for Believable AI: Expressed Doubt, Provenance, and Belief Revision as an Engineerable Stance

Sep 2026 · 1 citation · 44 references
Computer Science

TL;DR

This work test whether expressed uncertainty, provenance-aware assertion, and explicit belief revision can be implemented as a behavior layer over a fixed language model over a fixed language model and supported conclusions are limited to the by-construction audit guarantee, store-dependent partial correction discrimination, and a benchmark- and model-specific failure of token-probability gating.

Abstract

Conversational agents often express answers in a uniformly confident register. We test whether expressed uncertainty, provenance-aware assertion, and explicit belief revision can be implemented as a behavior layer over a fixed language model; we do not test believability or trust. The layer combines three epistemic states, per-claim confidence and typed provenance, a provenance-gated expression rule, and a persistent revision store with auditable acknowledgments and partial resistance to false corrections. We evaluate it on a constructed, mechanically scored multi-session benchmark using a synthetic model and Qwen2.5-0.5B-Instruct. The synthetic instrument passes all five checks. On the real model, acknowledgment soundness, a by-construction guarantee, holds in 100% of cases, and true corrections are accepted more often than false ones (0.44 vs. 0.15 on held beliefs; 0.875 vs. 0.420 including rule-accepted corrections of unheld facts), but the pre-specified expression-fidelity, contradiction-separation, and provenance margins fail. A disclosed post hoc analysis shows that expression gated on mean answer-token probability ranks correctness below chance end to end (AUC 0.41, conversation-clustered), whereas gating on sampling consistency discriminates (AUC 0.66). A consistency-gated configuration selected from this finding and evaluated under a separately committed protocol meets the conversation-level manipulation and capability-equivalence criteria and replicates on a redrawn conversation set. The manipulation result is selection-dependent, and both criteria remain unresolved when uncertainty is clustered over the 60 facts. The supported conclusions are limited to the by-construction audit guarantee, store-dependent partial correction discrimination, and a benchmark- and model-specific failure of token-probability gating; scaling the fact base is required before human evaluation.

View source

Similar papers

Preprint Sep 2026

Stored Is Not Supported: Typed Provenance and Assertion Guardrails for Persistent AI Agents

Persistent AI agents construct autobiographical state through reflection, retrieval, and consolidation. Persistence changes availability, not epistemic standing: stored or retrieved material is not thereby supported. Untrusted inputs, prompt injections, and model inferences can therefore enter persistent state and late...

Jun-Fei He, De-Ying Yu · 1 citation

Structural Trust: An Uncertainty-Typed Property Hypergraph for Agent Memory

This paper argues that it is too late, and that the argument is not a matter of engineering quality: information about whether a claim is true enters through the primary record, and every later stage is a rendering of that record, so no downstream scoring can add a bit that the record did not already carry.

R. Deiotte · 0 citations
Open access Sep 2026

EviGuard: Machine-Verifiable Evidence Grounding for LLM-Based Industrial Incident Reasoning

EviGuard is presented, a system that decides when an LLM’s understanding is trustworthy enough to act on and has an ensemble of deterministic verifiers label every claim supported, contradicted, or unknown against the graph—honoring interval time, event-time policy and credential versions, network reachability, and phy...

Hao-Zhe Zhou, Hang Lei, Mao-Lin Yang · 0 citations
Preprint Sep 2026

VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement

VeriPhy, an auditable physical-verification system in which a text-only planner compiles the prompt into typed physical obligations and a statically validated execution plan before any frame is observed, is presented.

Wenzhuo Xu, Yu-Chen Zhu, Chongjian Ge et al. · 0 citations
#artificial intelligence Preprint Aug 2026

The Answer Is Not the Argument

Although the errors studied here were ordinary and mostly non-load-bearing rather than adversarial, trusted-answer evaluations may similarly overstate monitoring capability when acceptable outputs conceal unsound reasoning.

W. Yeadon, S. Juárez, P. Mackay et al. · 1 citation
#artificial intelligence Preprint Aug 2026

Ignorance or Incompetence? Constructing Knowledge-Gated, Verifiable Tasks for LLM Agents

A knowledge-gated task-construction protocol is introduced that separates a task instruction from a compact artefact containing private conventions, reference tables, and utility operators, and it is shown that the retained tasks improve post-training.

Han-Lin Tian, Min-Hao Li, Yuhan Mi et al. · 0 citations

Related blog posts

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.