Aug 2026· IEEE Robotics and Automation Letters· Vol 11, pp. 12839-12846· 0 citations· 31 references
Computer Science
TL;DR
Experimental results demonstrate that current methods struggle to complete the ESRP task efficiently, highlighting ESRP as a challenging frontier for embodied agents in scene understanding and long-horizon task planning.
Abstract
This paper introduces Embodied Scene Rearrangement Planning (ESRP), a novel task requiring embodied agents to rearrange furniture in 3D scenes to match a target configuration using only egocentric observations and a top-down target layout. Unlike prior rearrangement tasks, Embodied Scene Rearrangement Planning (ESRP) precludes global state access and introduces mutual object occlusions, reflecting the practical constraints of real-world robotic deployment. These factors make aligning partial egocentric observations with the global target layout particularly challenging for long-horizon planning. To facilitate research, we present ESRP-Bench, a comprehensive benchmark built on OmniGibson featuring over 5,400 scene pairs and 8,200 objects. We define three multi-level metrics to evaluate rearrangement quality and provide four baselines: a hierarchical task-and-motion planning method, a vision-language-model-based method, and two learning-based approaches (IL and RL). Experimental results demonstrate that current methods struggle to complete the task efficiently, highlighting ESRP as a challenging frontier for embodied agents in scene understanding and long-horizon task planning. This work serves as a stepping stone toward deploying intelligent agents in real-world scenarios.
GRAB-TAMP is introduced, an FM-based TAMP framework that searches for scene entities required for task completion, grounds functional roles to valid physical objects, and plans only after a complete joint assignment establishes functional sufficiency.
N. Vijayakumar, Nav Singhal, G. Varma et al.· arXiv.org· 0 citations
This paper provides a formalization of what constitutes a sufficient scene graph for planning by modeling planning over scene graphs within an information-spaces framework through the definition of scene graph transition systems and relevant action semantics for navigation and manipulation.
Basak Sakçak, Francesco Verdoja· arXiv.org· 0 citations
An adaptive task planning method based on video priors and dynamic scene graphs (ATP-VPDSG) that leverages the VLM to extract manipulation logic from video demonstrations, thus supplementing manipulation priors and outperforming the selected task planning baselines.
Guang-Hui Ma, Jia-Hui Guo, Xin-Hua Tang et al.· Italian National Conference...· 0 citations
Assistant Placement Aria is introduced, the first benchmark to explore diverse aspects of VP, including global, local, and human-centric constraints, and several foundation models for object detection and segmentation are evaluated on this benchmark.
Amir Belder, Goncalo Dias Pais, R. Vivanti et al.· IEEE International Conferenc...· 1 citation
This work introduces EgoTrack3D, a modular framework that reconstructs and maintains a dynamic 3D scene representation directly from egocentric RGB video, and replaces dense depth maps with sparse 3D bounding box estimation and integrate interaction-guided dynamic association, enabling EgoTrack3D to maintain accurate s...
Jan Kulik, Bjarni Dagur Thor Karason, Yung-Hsu Yang et al.· 0 citations
RoboPhys-3D, a 3D-grounded EWM benchmark built on RoboTwin 2.0, is introduced, and Average Full Score, a hierarchical score averaging all 50 metrics for comprehensive evaluation, and RoboPhyscore, a compact task-aligned score averaging the metrics most strongly correlated with task success are introduced.
Tian-Yi Wang, Jia-Zhou Chen, Yi-Ming Xu et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.