An active-perception framework for embodied target disambiguation is proposed that uses active observation as the backbone for information acquisition and uses a vision-language model to decide, on the basis of accumulated visual evidence and interaction information, whether to continue observing, request clarification, or complete target selection.
Abstract
Natural language provides robots with a flexible task interface, but target ambiguity in embodied environments arises not only from user intent; it can also result from missing taskrelevant physical evidence in the current observation. Existing interactive disambiguation methods primarily obtain additional information by asking the user, whereas occlusion, restricted viewpoints, unreadable text, and unobserved targets require the robot to actively change its observation. We propose an active-perception framework for embodied target disambiguation that uses active observation as the backbone for information acquisition and uses a vision-language model to decide, on the basis of accumulated visual evidence and interaction information, whether to continue observing, request clarification, or complete target selection. Active observation can both directly recover missing discriminative evidence and reveal object names, labels, and semantic attributes, thereby improving user clarification when it remains necessary. Real-robot experiments show that the framework combines physical information acquisition and userintent clarification within a unified embodied disambiguation process.
This work proposes a Bayesian framework that treats clarification as an active learning problem over grounded Signal Temporal Logic task specifications and uses LLMs to initialize candidate formal specifications and translate informative contrasts into natural-language clarification questions, while Bayesian optimizati...
Hu-Ao Li, Carson Sobolewski, A. Saravanos et al.· 0 citations
Visual Question Answering (VQA) in embodied settings draws on computer vision, natural language processing, and robotics. Unlike traditional VQA, Embodied Question Answering (EQA) may require an agent to acquire and retain evidence from a 3D environment before answering a natural language query. This semi-systematic su...
ActivAsk is presented, a zero-shot framework for resolving referential ambiguity before robotic grasping that selects among VLM-proposed candidate partitions using an expected free energy (EFE) criterion motivated by active inference; with neutral response preferences, this reduces to information gain over candidate pa...
Haoandong Yang, Gabriel W. Haddon-Hill, Teresa Zielińska et al.· Robotics· 0 citations
SAIN is presented, a zero-shot framework that turns active dialogue into persistent navigation state and supports dialogue-to-state conversion as an effective zero-shot mechanism for long-horizon interactive instance navigation.
JRDB-AVR is introduced, a benchmark derived from existing real-world JRDB robotics data through a structured question-generation engine that turns this gap between answer accuracy and evidence accuracy in current baselines into an explicit evaluation.
Zhixi Cai, Fu-Cai Ke, Sukai Huang et al.· 0 citations
Finding the object referred to by language in a partially observed 3D scene is a core capability for embodied agents. Existing approaches either couple object search with online exploration, which can be costly when relevant observations have already been captured, or query pre-built open-vocabulary maps and scene grap...
Shi-Xiong Xu, Zhi-Yuan Chen, Song Ding et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.