ABO-Edit is introduced, a dataset specifically designed to study object consistency, comprising over 12,000 triplets of source images, editing prompts, and high-quality target images rendered from artist-designed 3D assets, with multi-view coverage and human-verified quality control.
Abstract
Despite remarkable progress in text-guided image editing, generative models frequently fail to preserve visual object consistency, defined as the preservation of a subject's key attributes throughout the editing process. We address this limitation through three contributions. First, we introduce ABO-Edit, a dataset specifically designed to study object consistency, comprising over 12,000 triplets of source images, editing prompts, and high-quality target images rendered from artist-designed 3D assets, with multi-view coverage and human-verified quality control. Second, we uncover an overlooked property of image-editing rectified flow models: the conditioning embedding space, not directly supervised during training, encodes a prediction of the final generated image even at high noise levels. Third, exploiting this finding, we propose FlowMirror, a parameter-free auxiliary loss that supervises this conditioning embedding space. Without architectural changes, our method improves generation quality across several metrics over baselines.
The RenderMatte dataset is constructed, a large-scale synthetic dataset combining 3D-rendered RGBA foregrounds with diverse multi-source assets that features exact strand-level alpha annotations and diverse background composites, demonstrating a scalable path toward high-fidelity matting in open-world scenes.
Ze-Cheng Ren, Ya-Fei Hu, Jianing Zhao et al.· 0 citations
A comprehensive hierarchical taxonomy featuring over 1,000 fine-grained edit concepts is established and a dense supervision training strategy that synthesizes multiple non-interfering concepts into single image pairs is proposed that significantly enhances both training efficiency and overall model performance.
Long Cui, Xiao-Qian Liu, Qi Qin et al.· 0 citations
This work proposes InnoText, a unified DiT-based framework capable of performing both text generation and editing within a single model, and introduces a Font Size-Aware Modulation module to enhance representations across font scales, a Small-Character Aware Augmentation strategy to improve fine-grained fidelity, and a...
Hao-Wei Liu, Runze He, Jian Lu et al.· arXiv.org· 0 citations
This work proposes a hybrid pipeline coupling T2I generation with context-aware image-to-image (I2I) editing, and introduces VRAIN (Verified Rare-class Augmentation via INstructed editing), a novel I2I editor to strengthen supervision for rare classes.
Editing images with pre-trained text-to-image flow models typically requires carefully balancing target alignment with the desired prompt and source consistency with the original image. Existing approaches either rely on inversion-based pipelines or heuristic source-to-target trajectory constructions, which often depen...
Zehui Guo, Zhen Wang, Junwei Shu et al.· arXiv.org· 0 citations
This work takes a source-centric perspective on VAR editing, in which the encoded source image tokens serve as the primary visual state and the editing process focuses on condition-induced changes, and proposes EditMod, which compares source- and target-conditioned predictions under a shared autoregressive context.
Hongyi Fang, Chu-Wen Xie, Ben-Jia Zhou et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.