Skip to content

MulPlanLM: multimodal robotic task planning with vision-language models and physical feedback

Aug 2026 · Intelligent Service Robotics · Vol 19 · 0 citations · 40 references

TL;DR

Experimental results in various task scenarios show that the proposed framework consistently improves overall task success rates compared with unimodal settings with different LLMs and achieves a higher success rate compared to using only visual or force data.

View source

Similar papers

Open access Aug 2026

Large Language Model-Driven Symbolic Planning for Long-Horizon Robotic Manipulation Tasks

VLA-SP (Vision-Language-Action via Symbolic Planning), a two-stage Embodied Vision-Language-Action framework, enabling fully automated robotic execution from speech and vision inputs is proposed, demonstrating the strong interpretability, executability, and cross-platform applicability of the framework.

Han-Zhuo Zhang, Jiahao Xu, Yi-Chen Xu et al. · 0 citations
Open access Aug 2026

PFEA: a VLM-based high-level natural language planning and feedback embodied agent for human-centered AI

A closed-loop framework for planning and evaluation of a vision-language model-based robotic manipulation agent operating in tabletop object rearrangement and manipulation tasks and demonstrates the potential of closed-loop vision-language planning for human-centered robotic manipulation.

Wenbin Ding, Jun Chen, Mingjia Chen et al. · 0 citations
Preprint Aug 2026

Evidence-Gated Task and Motion Planning with Vision-Language Models

Evidence Acquisition and Feasibility Gating (EAFG) is proposed, a framework that acquires visual evidence through VLM-generated exploratory subgoals and TAMP-based execution and applies a feasibility gate to decide whether to proceed with task planning, acquire further evidence, or halt.

Tsunehiko Tanaka, Matthew Stephenson, Alistair Macvicar et al. · 0 citations
Aug 2026

Visual Embodied Brain-1.5: Enhanced Perception, Spatial Reasoning and Robot Control in Spaces.

Visual Embodied Brain-1.5 (VeBrain-1.5) is presented, a task-level unified framework that connects multimodal perception and spatial reasoning with robot control through a shared MLLM-compatible decision interface and shows strong adaptability, flexibility, and compositional capabilities compared to existing methods.

Gan-Lin Yang, G. Luo, Ziyang Gong et al. · 2 citations
Conference Jul 2026

Evaluation of Vision-Language Models for Task-Oriented Robotic Grasping

This study comparatively examines the task-oriented grasping problem, which is of critical importance in robotic manipulation, through modern Vision-Language Models. Within the scope of the study, the performance rates of the GraspMolmo model, specifically trained for robotic tasks, and Gemini ER-1.5, a general-purpose...

Ceren Dinç, Ayhan Küçükmanísa, Ozan Kaya · 0 citations
Preprint Jul 2026

APIVOT: Adaptive Planning with Interleaved Vision-Language Thoughts

This work proposes APIVOT, a VLM-based planner that adaptively interleaves language and visual thoughts for long-horizon planning that outperforms general-purpose VLMs and prior planning frameworks, achieving the largest gains in spatially constrained settings.

Emily Jin, Joy Hsu, Yiqing Xu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.