Skip to content
Conference Open access

MedVLA: A Hierarchical Vision-Language-Action Framework for Closed-Loop Precision Medical Robot Manipulation

Aug 2026 · 2026 IEEE 22nd International Conference on Automation Science and Engineering (CASE) · pp. 1920-1927 · 0 citations · 24 references
Computer Science

TL;DR

The proposed MedVLA is a hierarchical framework that couples high-level multimodal reasoning with lowlevel function-constrained execution for deployable precision medical robotics, and demonstrates the effectiveness of the proposed framework across model variants.

Abstract

Precision medical robotics demands adaptive decision-making under strict safety, interpretability, and execution constraints. Although recent Vision-Language-Action (VLA) models show strong multimodal reasoning ability, their continuous action generation paradigm is not well suited for precision medical tasks, where reliable closed-loop operation may also depend on non-action system function calls. To address this gap, we propose MedVLA, a hierarchical framework that couples high-level multimodal reasoning with lowlevel function-constrained execution. We further introduce a scalable multi-agent pipeline to generate skill-oriented chainof-thought(CoT) data for structured training. Built on different multimodal large-model backbones, MedVLA consistently improves performance after fine-tuning, demonstrating the effectiveness of the proposed framework across model variants. Under identical initial conditions, we perform 100 closed-loop flexible electrode implantation trials. The results show that MedVLA achieves a 95.0% task success rate, substantially outperforming representative VLA baselines, including OpenVLA (8%) and $\pi_{0}$ (15%), in accuracy, stability, and safety. These results indicate that structured reasoning with constrained function-level execution is a practical route toward deployable precision medical robotics.

Read PDF

Similar papers

Preprint Sep 2026

MobileVLA-R1 2.0: RL-Enhanced Reasoning for Mobile Robot Control

This work proposes MobileVLA-R1 2.0, an RL-enhanced VLA framework that explicitly couples structured embodied reasoning with executable mobile robot control, and introduces a reasoning-conditioned action decoder that maps multimodal reasoning representations to task-level action targets, which are subsequently translat...

Ting Huang, Yue Huang, Ze-Yu Zhang et al. · 1 citation
Preprint Aug 2026

NebulaVLA: A Dual-Frequency Vision-Language-Action Model With Guide Action for Robotic Manipulation

NebulaVLA is presented, an asynchronous dual-frequency architecture that decouples high-level semantic reasoning from low-level action control, optimizing computational resources and modularity and introduces GESTURE-7, a unified language-grounded action representation.

Congyu Zhao, Shuai Tian, Xu Zhang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

SurgiCLAW: An Interpretable Atomic-Skill Agent for Precision Robotic Micromanipulation

Recent multimodal large language models (MLLMs) and vision--language--action models have provided robots with new capabilities for long-horizon task understanding and planning. In surgical robotics, however, end-to-end prediction of low-level actions remains limited by insufficient precision, opaque decisions, and scar...

An-Gen Ye, Jun-Jie Xie, Yu-Jia Song et al. · 0 citations
Preprint Sep 2026

MotorMind: Scaffolding General Vision Language Models for Zero-Shot Robot Manipulation

MotorMind is introduced, a robot manipulation harness that connects VLM-proposed mid-level actions to deterministic robot control and feedback, with asynchronous monitoring and background memory updates, and shows that a general-purpose VLM, when equipped with an appropriate mid-level action representation and asynchro...

Bing-Xuan Li, Si-Qi Song, Yi-Zhuo Wu et al. · 0 citations
Conference Aug 2026

RoVLA: Action-Conditioned Temporal Grounding and Structured Conditioning for Vision–Language–Action Policies

Vision-Language-Action (VLA) models have shown strong potential for robotic manipulation, yet pretrained policies do not always expose the information needed for precise action generation. In particular, effective control can benefit from (i) temporal context that reflects how recent actions have shaped the current sce...

Pei-Sen Huang, Jian-Hua Hu, Jie-Ren Deng et al. · 0 citations
Aug 2026

MulPlanLM: multimodal robotic task planning with vision-language models and physical feedback

Experimental results in various task scenarios show that the proposed framework consistently improves overall task success rates compared with unimodal settings with different LLMs and achieves a higher success rate compared to using only visual or force data.

Young-Chae Son, Dong-Han Lee, Soo-Chul Lim · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.