Long-horizon embodied manipulation requires policies to act on information that is no longer visible. Modified objects may leave the field of view, while completed subtasks continue to constrain future actions. Existing approaches extend temporal context through recurrent state updates, test-time training, or storage a...
Di-Qi He, Jin-Bang Guo, Yi-Jun Shen et al.· 0 citations
Multimodal large language models (MLLMs) show promising reasoning capabilities, but reliable physical interaction requires planning that accounts for when actions are executable and how they change the world. These preconditions and effects are environment-dependent and often not captured by MLLMs, making adaptation ch...
Yi-Jun Shen, Di-Qi He, Jin-Bang Guo et al.· 0 citations
This work introduces DynamicEnvPlan, a closed-loop framework for high-level planning in dynamic environments that extends embodied task execution with humanoid agents, high-level primitive skills, structured semantic memory, and controllable perturbations.
The Semantically Rich World Model is presented, a task-conditioned world model structured around five functional roles: gripper, target, goal, relation, and phase, which transforms object-centric prediction into a semantic interface linking visual dynamics with planning-oriented decision making.
Juntao Cheng, Jingkai Wang, Yi-Jun Shen et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.