Skip to content
Conference

A conceptual framework for hallucination detection and mitigation in VLM-driven embodied agents

Nov 2026 · International Conference on Communication, Sensing and Intelligent Computing · Vol 14527, pp. 1452711 - 1452711-8 · 0 citations · 15 references
Engineering

TL;DR

EviD-M is introduced as a conceptual computer-vision framework based on evidence-aware VLMs and embodied-perception research to organise atomic-claim scoring via region alignment, RGB-D geometry, temporal memory, counterfactual masking and token uncertainty.

Abstract

Embodied agents driven by vision-language models (VLMs) can describe a scene fluently and invent objects, attributes, relations or executable targets. Such errors may cause serious injury if the language response is translated into navigation or manipulation operations. This paper introduces EViD-M as a conceptual computer-vision framework based on evidence-aware VLMs and embodied-perception research. Organise atomic-claim scoring via region alignment, RGB-D geometry, temporal memory, counterfactual masking and token uncertainty. A risk-aware decoder is used to modify unsupported claims, issue abstentions, and forbid unsafe behaviour until a confirming view is obtained. The framework specifies a scene-isolated EHA-Indoor stress-set protocol with 1,200 photorealistic RGB-D episodes covering object absence, attribute swaps, relation swaps and occlusion. AUROC, expected calibration error, hallucination rate, unsafeaction rate and task success are defined as evaluation indicators, and the numerical profiles presented below serve as reference values for subsequent empirical verification. Conduct physical-robot experiments to evaluate the application effect.

View source

Similar papers

Preprint Nov 2026

STVLA: Spatial-aware and Temporal-memory forVision-Language-Action Models

Robotic manipulation often requires both spatial scene understanding and task history. However, many vision-language-action (VLA) policies rely primarily on current observations, without explicitly integrating spatial structure and task history. Appearance-based memories can be sensitive to occlusion and viewpoint chan...

Zhuo Han, Ye-Qiang Wang, Xin-Ran Wang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

CoWorld Reasoner: Agentic Multimodal Reasoning with the Evolving Video World Model-Driven Harness

CoWorld Reasoner, an agentic framework that uses a VWM as a unified visual reasoning engine, and VLM-VWM Harness Co-Evolution, which jointly revises tools, skills, and execution code based on execution feedback while keeping both model weights fixed.

Dong-Jie Cheng, Rui-Feng Yuan, Ran Wei et al. · 1 citation
Open access Oct 2026

DyGRAV: Dynamic Grounding and Relational Reasoning for Vision–Language Navigation

Vision–Language Navigation (VLN) requires embodied agents to interpret natural-language instructions in 3D environments. While significant progress has been made, state-of-the-art agents often struggle with instructions that demand fine-grained visual understanding, correctly grounding specific object attributes, disti...

Zain Chaudhary, Zohaib Chaudhary, Hammad Ahmed et al. · 0 citations
Book Nov 2026

A Two-Stage Agentic Framework for Explainable Deepfake Detection in the 2026 ACM Multimedia TRIDENT Image Track

Recent advances in generative models have made facial image manipulation increasingly realistic, requiring deepfake detection systems to move beyond binary decisions and provide reliable artifact perception and faithful explanations. To address this challenge, we propose a two-stage agentic framework for the TRIDENT Im...

Tai-Ming Huang, Yu Zhu, Tzu-Heng Peng et al. · 0 citations
Book Open access Oct 2026

Depth-Grounded Vision Language Models: Conversational AI in Spatial Interfaces for Robot-Supported Mixed Reality

Large language models (LLMs) and vision-language models (VLMs) are increasingly used in mixed-reality (MR) interfaces, yet most operate on text or 2D imagery and remain unreliable for metric spatial reasoning. We present an exploratory robot-supported MR prototype that combines RGB-D sensing, YOLO object detection, and...

Rodrigo Gutiérrez Maquilón, Marita Huber, Georg Regal et al. · 0 citations
Preprint Oct 2026

GeoBridge-VLA: Geometry-Aware Residual Adaptation for Vision-Language-Action Models

Vision-language-action (VLA) models encode semantic information from vision-language pretraining, but manipulation also requires precise spatial reasoning. We present GeoBridge-VLA, a two-stage method for learning geometric features from a pretrained VLA's frozen visual encoder and using them for action prediction. Sta...

Hyunjung Song, Kangmin Kim, Loren Jinsoo Um et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.