Aug 2026· IEEE Transactions on Pattern Analysis and Machine Intelligence· Vol PP· 0 citations
Medicine
TL;DR
Pose-Star++ is proposed, a training-free, plug-and-play framework that introduces two core innovations: an LVLM-based Understanding Module that shifts from word- to sentence-level semantic-visual comprehension, eliminating cumbersome instruction pre-parsing and enabling robust understanding of complex natural language.
Abstract
Fashion image editing demands high-dimensional, fine-grained control to follow personalized, unpredictable natural-language instructions. Yet current methods are limited by a fundamental trade-off: fashion-specific approaches offer structural accuracy but lack semantic flexibility, while general text-driven editors are semantically flexible but structurally inaccurate. To bridge this gap, we propose Pose-Star++, a training-free, plug-and-play framework that introduces two core innovations: an LVLM-based Understanding Module that shifts from word- to sentence-level semantic-visual comprehension, eliminating cumbersome instruction pre-parsing and enabling robust understanding of complex natural language; a Bidirectional Calibration Module that co-optimizes semantic and structural constraints through forward pose-guided and backward attention-guided refinement, achieving precise, whole-body-reachable region calibration even under challenging in-the-wild poses. We further contribute the first real-world-oriented fashion-editing benchmark with diverse data, instructions, and tasks, exposing long-overlooked practical challenges. Extensive experiments demonstrate that Pose-Star++ significantly outperforms existing methods in semantic alignment, pose robustness, and in-the-wild generalization across complex scenarios, advancing toward practical, user-guided fashion creation.
An automated pipeline leveraging Multimodal Large Language Models (MLLMs) is developed to synthesize comprehensive quadruplets comprising original images, local geometric sketches, semantic instructions, and corresponding edited images, which uniquely enables collaborative spatial-semantic learning.
Weixin Ye, Wei Wang, Hong-Guang Zhu et al.· 0 citations
A novel self-supervised framework that enables granular control over image generation through a visual abstraction set that provides a richer, more flexible paradigm for creative design compared to state-of-the-art baselines across diverse styles and compositions is introduced.
Amir Hertz, Noah Snavely· European Conference on Compu...· 0 citations
RA-CoA is a model-agnostic approach that works with frozen VLMs to improve fine-grained attribute precision in product captions without the need for fine-tuning, and is proposed as a novel, training-free framework that disentangles fashion image captioning into two interpretable stages.
A. S. Penamakuri, Shreya Shukla, Anand Mishra· Trans. Mach. Learn. Res.· 0 citations
The Robust and Fine-grained training framework for CLIP-based vision-language models (RoFLIP) is proposed, enhancing both the robustness and granularity of vision-language alignment and underscore RoFLIP’s compositional reasoning and generalization abilities.
Yiwei Sun, Chuan-Bin Liu, Shan-Cheng Fang et al.· International Journal of Com...· 0 citations
Pr PrismGPT, a Vision-Language Model (VLM) framework that produces structured, region-aware editing plans from a single input image without relying on commercial black-box tools is presented.
Ke Zhao, Hue Nguyen, Abhijith Punnappurath et al.· 0 citations
This work proposes Visual In-context Editing, a new paradigm elevating video editing from textual instructions to multi-modal visual guidance encompassing single image, image pair, and video pair, and curates VicEdit-400K, the first large-scale dataset for visual in-context video editing.
Yu-Ji Wang, Teng Hu, Yu-Heng Chen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.