Aug 2026· 2026 IEEE 22nd International Conference on Automation Science and Engineering (CASE)· pp. 1920-1927· 0 citations· 24 references
Computer Science
TL;DR
The proposed MedVLA is a hierarchical framework that couples high-level multimodal reasoning with lowlevel function-constrained execution for deployable precision medical robotics, and demonstrates the effectiveness of the proposed framework across model variants.
Abstract
Precision medical robotics demands adaptive decision-making under strict safety, interpretability, and execution constraints. Although recent Vision-Language-Action (VLA) models show strong multimodal reasoning ability, their continuous action generation paradigm is not well suited for precision medical tasks, where reliable closed-loop operation may also depend on non-action system function calls. To address this gap, we propose MedVLA, a hierarchical framework that couples high-level multimodal reasoning with lowlevel function-constrained execution. We further introduce a scalable multi-agent pipeline to generate skill-oriented chainof-thought(CoT) data for structured training. Built on different multimodal large-model backbones, MedVLA consistently improves performance after fine-tuning, demonstrating the effectiveness of the proposed framework across model variants. Under identical initial conditions, we perform 100 closed-loop flexible electrode implantation trials. The results show that MedVLA achieves a 95.0% task success rate, substantially outperforming representative VLA baselines, including OpenVLA (8%) and $\pi_{0}$ (15%), in accuracy, stability, and safety. These results indicate that structured reasoning with constrained function-level execution is a practical route toward deployable precision medical robotics.
This work proposes MobileVLA-R1 2.0, an RL-enhanced VLA framework that explicitly couples structured embodied reasoning with executable mobile robot control, and introduces a reasoning-conditioned action decoder that maps multimodal reasoning representations to task-level action targets, which are subsequently translat...
Ting Huang, Yue Huang, Ze-Yu Zhang et al.· 1 citation
NebulaVLA is presented, an asynchronous dual-frequency architecture that decouples high-level semantic reasoning from low-level action control, optimizing computational resources and modularity and introduces GESTURE-7, a unified language-grounded action representation.
Congyu Zhao, Shuai Tian, Xu Zhang et al.· 0 citations
Recent multimodal large language models (MLLMs) and vision--language--action models have provided robots with new capabilities for long-horizon task understanding and planning. In surgical robotics, however, end-to-end prediction of low-level actions remains limited by insufficient precision, opaque decisions, and scar...
An-Gen Ye, Jun-Jie Xie, Yu-Jia Song et al.· 0 citations
MotorMind is introduced, a robot manipulation harness that connects VLM-proposed mid-level actions to deterministic robot control and feedback, with asynchronous monitoring and background memory updates, and shows that a general-purpose VLM, when equipped with an appropriate mid-level action representation and asynchro...
Bing-Xuan Li, Si-Qi Song, Yi-Zhuo Wu et al.· 0 citations
Vision-Language-Action (VLA) models have shown strong potential for robotic manipulation, yet pretrained policies do not always expose the information needed for precise action generation. In particular, effective control can benefit from (i) temporal context that reflects how recent actions have shaped the current sce...
Pei-Sen Huang, Jian-Hua Hu, Jie-Ren Deng et al.· 2026 IEEE 22nd International...· 0 citations
Experimental results in various task scenarios show that the proposed framework consistently improves overall task success rates compared with unimodal settings with different LLMs and achieves a higher success rate compared to using only visual or force data.