Skip to content
Log in
Preprint

Structure-Detail Decoupled Autoregressive Generation for Fast and High-Fidelity Virtual Try-On

Lu Yang Xiaonan Hu Yanan Li Daqi Liu Xiang Bai Hao Lu
Jul 2026 · 0 citations · 44 references
Computer Science

TL;DR

This work introduces VAR-VTON, a VAR-based VTON model that incorporates garment conditioning and structural guidance for efficient latent-space VTON, and proposes STAR-VTON, a Two-Stage AutoRegressive framework that builds upon VAR-VTON by decoupling latent-space structural synthesis from pixel-space detail recovery.

Abstract

Virtual try-on (VTON) is a bi-conditional image generation problem that requires not only accurate person preservation but also faithful garment deformation and detail synthesis. Diffusion-based VTON methods can jointly model these factors in a compressed latent space, but suffer from high-frequency detail loss due to inherent latent compression, even with costly multi-step denoising. Recent visual autoregressive (VAR) models offer a promising alternative for high-quality generation with faster inference, yet remain unexplored for VTON due to the lack of effective bi-conditioning mechanisms. To bridge this gap, we first introduce VAR-VTON, a VAR-based VTON model that incorporates garment conditioning and structural guidance for efficient latent-space VTON. Despite its efficacy, latent-space generation still struggles to preserve fine-grained garment details. We argue that different VTON sub-tasks should be addressed in different representation spaces: structural synthesis such as garment warping and person layout is suited to the latent space, whereas fine-grained detail recovery should be tackled in the pixel space. Motivated by this insight, we further propose STAR-VTON, a Two-Stage AutoRegressive framework that builds upon VAR-VTON by decoupling latent-space structural synthesis from pixel-space detail recovery. Our idea is to resort to a matching-informed refiner to establish dense correspondences between the stage-one generation and the source garment to directly map fine-grained pixel-space details. Extensive experiments show that STAR-VTON achieves an impressive efficiency-fidelity trade-off: VAR-VTON runs at least $4\times$ faster than diffusion-based counterparts without degrading quality, and the pixel-space refiner effectively restores fine details and acts as a plug-and-play module that can benefit existing VTON approaches.

arXiv Semantic Scholar
View source

Similar papers

Preprint Aug 2026

MotionCraft: Latent World Modeling with Sparse Attention for Visual Upscaling

MotionCraft is presented, a controllable VSR framework that formulates restoration as motion-aware latent state prediction inspired by world models and integrates adaptive sparse attention with an explicit user-accessible control interface to deliver temporally consistent, high-quality reconstructions under streaming constraints.

Rong Fu, Chunlei Meng, Yangcheng Zeng et al. · 0 citations
Preprint Jul 2026

MSVS-VAE: Multi-Scale Anchored VecSet for High-Fidelity 3D Reconstruction

The key idea is to progressively densify anchored VecSet latents via hierarchical point-shuffle upsampling, increasing spatial capacity for fine-grained geometry modeling and replacing global cross-attention with AVS-Conv, a geometry-aware local aggregation operator operating within local neighborhoods rather than the exhaustive latent set.

Dehao Hao, Kaiyi Zhang, Tanghui Jia et al. · 0 citations
Preprint Aug 2026

Hybrid-Domain Posterior Sampling for Inverse Problems via Latent Flow Matching

This paper proposes Hybrid-Domain Posterior Sampling (HDPS), a decoupled inference framework that disentangles physical measurement consistency from semantic prior modeling, and establishes a new state-of-the-art, successfully recovering the high-frequency structural precision that latent-only solvers inherently discard.

Hongjie Wu, Yiping Xie, Jiancheng Lv · 0 citations
Preprint Aug 2026

HiFi-BRep: High-Fidelity Latent Representation for Robust B-Rep Generation

Boundary representation (B-Rep) generation is a fundamental task in computer-aided design, yet the direct synthesis of high-fidelity and structurally valid B-Reps remains a major challenge. Existing deep generative methods suffer from two forms of brittleness: representation brittleness, caused by padding noise and feature contamination in the latent space, and generation brittleness, stemming from sequential error propagation and a train-inference mismatch due to non-differentiable validity enforcement. We propose HiFi-BRep, a novel framework that addresses these limitations through two synergistic contributions. First, a topology-aware encoder constructs a high-fidelity latent representation by eliminating padding via learnable queries and preventing feature contamination with topology-guided attention. Second, a single-stage decoder jointly predicts geometry and topology in parallel, embedding core manifold constraints as a differentiable learning objective. This design ensures mutual guidance between geometry and topology while avoiding cascaded errors. Extensive experiments show that HiFi-BRep significantly outperforms state-of-the-art methods in both structural validity and geometric fidelity, providing a robust solution for high-quality B-Rep synthesis. Code and models are publicly available at https://github.com/1nnoh/HiFi-BRep.

Junhao Hou, Chenqi Luo, Pufan Wang et al. · 0 citations
Aug 2026

SCALAR++: Efficient Controllable Generation via Scale-wise Visual Autoregressive Learning

This work proposes a Scale-wise Conditional Decoding mechanism, which projects semantic signals from a frozen vision encoder into scale-specific layers of the VAR backbone, and introduces a Unified Control Alignment strategy (SCALAR-Uni) to handle diverse control modalities within a single projection space.

Ryan Xu, Dongyang Jin, Shawn Chen et al. · 0 citations