Skip to content
Conference

A Multi-Obstacle Instruction-Following Benchmark with an Obstacle-Aware Manipulation Framework

Jul 2026 · 2026 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM) · pp. 1-7 · 0 citations · 43 references

Abstract

Robotic manipulation in complex scenes requires robust reasoning and fine-grained part-level control. While recent language-guided policies have demonstrated strong manipulation capabilities, most existing benchmarks lack explicit obstacles and other sources of interference, and do not provide corresponding obstacle-aware solutions. To address this, we introduce MOBInstruct, a benchmark for part-level manipulation in cluttered environments with obstacles, along with a hierarchical framework, MOBA, for obstacle-aware execution. The MOBA framework consists of high-level modules for task planning and scene reasoning, as well as low-level modules for part-level action execution with position-aware noise initialisation. Within our framework, we evaluate representative baselines on the MOBIn-struct benchmark. Experiments demonstrate effective obstacle removal and robust task completion in multi-object scenes under diverse environmental conditions, including lighting and tabletop textures. Project website: https://j-x-chen.github.io/mobinstruct/

View source

Similar papers

Jul 2026

IMBench: A Benchmark for Intuitive Robotic Manipulation

IMBENCH is introduced, a benchmark designed to evaluate intuitive manipulation as an integrated capability spanning perception, physical reasoning, action generation, and iterative execution, and position IMBENCH as a step toward evaluating and enabling more integrated, adaptive physical intelligence.

Anurag Maurya, Sukhvansh Jain, Prajwal Avhad et al. · 0 citations
Preprint Aug 2026

Evidence-Gated Task and Motion Planning with Vision-Language Models

Evidence Acquisition and Feasibility Gating (EAFG) is proposed, a framework that acquires visual evidence through VLM-generated exploratory subgoals and TAMP-based execution and applies a feasibility gate to decide whether to proceed with task planning, acquire further evidence, or halt.

Tsunehiko Tanaka, Matthew Stephenson, Alistair Macvicar et al. · 0 citations
Conference Open access Jul 2026

ZONDA: Zero-shot Object Navigation with Dynamic Avoidance in Multi-floor Environments

ZONDA, a zero-shot object navigation with dynamic avoidance framework, integrates three core components and can maintain robust navigation on the dynamic benchmark HM3D-DYNA compared to the existing baseline.

Shao-Min Liang, Xuan-Hong Liao, Shi-Yao Zhang · 0 citations
Preprint Aug 2026

Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction

RoomWright is presented, an agentic usage-driven framework for generating 3D scenes represented entirely as code for embodied interaction, providing interactive environments for embodied AI and policy learning.

Zijian Xiao, Zi-Peng Ye, Jin-Kun Hao et al. · 1 citation
Jul 2026

LENS: LLM-guided Environment Simplification for Planning and Control in Clutter

This work proposes a plug-and-play fix to automatically generate scene-specific, task-specific, adaptively updating abstractions on top of existing planning and control stacks, and shows that LENS improves classical planning, model-based control, and a vision-language-action model, across a diverse set of highly clutte...

Aileen Liao, Rachel Holladay, Dinesh Jayaraman et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.