Skip to content
Review Open access

Foundation Models for Medical Image Segmentation: Technical Progress, Clinical Translation, and Governance Challenges

Jul 2026 · Scientific Journal of Technology · 0 citations · 37 references

TL;DR

Current evidence suggests that foundation models are most promising when they are deployed as interactive, auditable components within human-in-the-loop workflows, where they can reduce annotation burden, support rapid draft segmentation, and improve consistency across large imaging studies.

Abstract

Medical image segmentation is moving from task-specific convolutional models toward foundation models that can be adapted across organs, modalities, and clinical tasks with fewer manual labels. This transition has been accelerated by self-supervised pretraining, vision-language learning, and promptable segmentation frameworks such as the Segment Anything Model and its medical derivatives. However, the clinical value of these systems cannot be inferred from technical novelty alone. Medical images differ from natural images in dimensionality, intensity statistics, acquisition protocols, disease prevalence, and safety requirements, and recent evaluations show that naive zero-shot transfer remains inconsistent across modalities and lesion types. This narrative review synthesizes literature published up to May 22, 2026, on foundation models for medical image segmentation, with emphasis on technical evolution, application scenarios, validation strategies, and governance needs. Current evidence suggests that foundation models are most promising when they are deployed as interactive, auditable components within human-in-the-loop workflows, where they can reduce annotation burden, support rapid draft segmentation, and improve consistency across large imaging studies. Their translation into routine practice requires external validation, uncertainty-aware quality control, prospective workflow evaluation, bias assessment, and transparent reporting under medical AI guidelines. Future work should prioritize patient-level multimodal modeling, 3D and longitudinal segmentation, federated evaluation, and clinically meaningful endpoints rather than isolated benchmark gains.

Read PDF

Similar papers

Preprint Sep 2026

From Few-Shot Segmentation to Clinician-in-the-Loop Medical Image Analysis

This work reframe FSMIS as a three-layer sequential decision problem, state six hypotheses with an explicit dependency order, and proposes a minimal pilot that can falsify the foundational self-assessment claim before a clinician study.

Ya-Zhou Zhu · 0 citations
Review Aug 2026

Foundation models in medical image analysis: A systematic review and quantitative analysis.

This review provides a comprehensive and structured synthesis of FMs in medical image analysis by systematically organizing studies into two primary categories: vision-only foundation models (VFMs) and vision-language foundation models (VLFMs), based on their architectural foundations, training strategies, and downstre...

P. Rajendran, M. Safari, Wen-Feng He et al. · 0 citations
Jul 2026

Benchmarking Foundation and Large Language Models for Few-Shot Medical Image Segmentation

FAME is introduced, a unified benchmark for evaluating FS-MIS solutions, covering specialists, SAM-based methods, CLIP-based methods, and MLLM-based methods, and evaluates models under zero-shot and ten-shot settings with additional assessment of target-absence recognition and generalization under covariate and semanti...

Jinghong Liu, Yuchuan Deng, Fan-Ping Liu et al. · 0 citations
Conference Jul 2026

GroundMed-SAM: Prompt-based Zero-shot Medical Image Segmentation

Medical image segmentation is a key component of computer-aided diagnosis and treatment planning. Despite substantial progress in deep learning–based models, most existing approaches depend heavily on large annotated datasets and often fail to generalize across heterogeneous clinical environments, limiting their deploy...

V. Nguyen, Hoang Quan Luong, Phuc Ngoc Pham · 0 citations
Review Open access Jul 2026

Uncertainty Quantification in Medical Image Segmentation: A Comprehensive Survey

A comprehensive survey of UQ techniques in medical image segmentation is presented, categorizing existing approaches into Bayesian methods, deep ensembles, deterministic methods, test-time data augmentation, and hybrid models, while treating foundation-model-based UQ as a separate cross-cutting category.

Seyed Sina Ziaee, K. Ovens · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.