Skip to content

Pose-Star++: Semantic-Visual Understanding for Fine-Grained Fashion Image Editing.

Aug 2026 · IEEE Transactions on Pattern Analysis and Machine Intelligence · Vol PP · 0 citations
Medicine

TL;DR

Pose-Star++ is proposed, a training-free, plug-and-play framework that introduces two core innovations: an LVLM-based Understanding Module that shifts from word- to sentence-level semantic-visual comprehension, eliminating cumbersome instruction pre-parsing and enabling robust understanding of complex natural language.

Abstract

Fashion image editing demands high-dimensional, fine-grained control to follow personalized, unpredictable natural-language instructions. Yet current methods are limited by a fundamental trade-off: fashion-specific approaches offer structural accuracy but lack semantic flexibility, while general text-driven editors are semantically flexible but structurally inaccurate. To bridge this gap, we propose Pose-Star++, a training-free, plug-and-play framework that introduces two core innovations: an LVLM-based Understanding Module that shifts from word- to sentence-level semantic-visual comprehension, eliminating cumbersome instruction pre-parsing and enabling robust understanding of complex natural language; a Bidirectional Calibration Module that co-optimizes semantic and structural constraints through forward pose-guided and backward attention-guided refinement, achieving precise, whole-body-reachable region calibration even under challenging in-the-wild poses. We further contribute the first real-world-oriented fashion-editing benchmark with diverse data, instructions, and tasks, exposing long-overlooked practical challenges. Extensive experiments demonstrate that Pose-Star++ significantly outperforms existing methods in semantic alignment, pose robustness, and in-the-wild generalization across complex scenarios, advancing toward practical, user-guided fashion creation.

View source

Similar papers

Preprint Aug 2026

SI-Edit: Toward Sketch-Instruction Guided Local Image Editing with Pixel-Level Precision

An automated pipeline leveraging Multimodal Large Language Models (MLLMs) is developed to synthesize comprehensive quadruplets comprising original images, local geometric sketches, semantic instructions, and corresponding edited images, which uniquely enables collaborative spatial-semantic learning.

Weixin Ye, Wei Wang, Hong-Guang Zhu et al. · 0 citations
Conference 2026

FlowLess: Controlling Abstract Image Generation

A novel self-supervised framework that enables granular control over image generation through a visual abstraction set that provides a richer, more flexible paradigm for creative design compared to state-of-the-art baselines across diverse styles and compositions is introduced.

Amir Hertz, Noah Snavely · 0 citations

RA-CoA: Training-free Fashion Image Captioning via Retrieval-Augmented Chain-of-Attributes

RA-CoA is a model-agnostic approach that works with frozen VLMs to improve fine-grained attribute precision in product captions without the need for fine-tuning, and is proposed as a novel, training-free framework that disentangles fashion image captioning into two interpretable stages.

A. S. Penamakuri, Shreya Shukla, Anand Mishra · 0 citations
Open access Aug 2026

RoFLIP: Robust and Fine-Grained Alignment for Vision-Language Compositional Reasoning

The Robust and Fine-grained training framework for CLIP-based vision-language models (RoFLIP) is proposed, enhancing both the robustness and granularity of vision-language alignment and underscore RoFLIP’s compositional reasoning and generalization abilities.

Yiwei Sun, Chuan-Bin Liu, Shan-Cheng Fang et al. · 0 citations
Preprint Aug 2026

VicEdit: Learning to Edit Videos from Visual In-Context Examples

This work proposes Visual In-context Editing, a new paradigm elevating video editing from textual instructions to multi-modal visual guidance encompassing single image, image pair, and video pair, and curates VicEdit-400K, the first large-scale dataset for visual in-context video editing.

Yu-Ji Wang, Teng Hu, Yu-Heng Chen et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.