MultiCompose is presented, a composition framework that decouples per-concept personalization from multi-subject inference and MSP-Bench is introduced, a benchmark that jointly evaluates identity fidelity, attribute binding accuracy, and attribute misalignment through a dual-pathway protocol.
Abstract
Text-to-image diffusion models enable personalization of specific visual concepts from a small number of reference images. However, generating a single image that contains multiple personalized subjects, each bound to user-specified attributes such as clothing, accessories, and held objects, remains largely unaddressed. Without explicit spatial constraints, concurrently activated concept checkpoints produce overlapping cross-attention responses, causing per-subject identity degradation and attribute misalignment. Moreover, no established benchmark jointly evaluates these two failure modes in the personalized multi-subject setting. We present MultiCompose, a composition framework that decouples per-concept personalization from multi-subject inference. A semantic preservation regularization maintains attribute binding capacity during fine-tuning, while a two-phase inference procedure automatically establishes subject layout and composes per-concept predictions through spatially exclusive masks. We further introduce MSP-Bench, a benchmark that jointly evaluates identity fidelity (ID), attribute binding accuracy (BIND), and attribute misalignment (MIS) through a dual-pathway protocol. Experiments show that MultiCompose outperforms existing methods on both conventional metrics and MSP-Bench, confirming the benchmark's ability to reveal failure modes that conventional metrics overlook. Code is available at https://github.com/I2-Multimedia-Lab/MultiCompose
Subject-driven image personalization---generating new images that preserve the identity of one or several reference subjects in novel scenes---is a foundational capability for modern visual content creation. It is currently dominated by generalized methods that fine-tune a pretrained multimodal diffusion transformer (M...
Jihun Park, Kyoungmin Lee, Jongmin Gim et al.· 0 citations
Personalized segmentation and personalized retrieval both aim to identify the same physical object across different images. While the former localizes the object within a target image, the latter retrieves images where it appears. Despite this shared instance-level objective, the two tasks have largely evolved separate...
Gabriele Trivigno, Marcos Alfaro, C. Cuttano et al.· 0 citations
Compositional text-to-image generation requires faithful depiction of multiple objects with distinct visual attributes. While recent inference-time optimization methods have substantially improved attribute binding, entity neglect - where specified objects are absent from the generated image - remains an unresolved fai...
Trong-Tai Dam Vu, Vinh-Tiep Nguyen· International Conference on...· 0 citations
This work proposes RIG (Regional Image-prompt Generation), a novel training-free framework for multi-reference personalized generation that significantly outperforms state-of-the-art adapter methods in terms of both personalization fidelity and text-layout alignment.
Junhao Feng· Poster Volume 0008 The 2026...· 0 citations
Generative diffusion models have achieved substantial progress in image content creation, yet practical interactive generation remains challenging when heterogeneous conditions must be jointly interpreted, fine-grained attributes must be controlled independently, and users need to iteratively refine generated results....
V-Engram is introduced, a trigger-indexed external memory mechanism for Stable Diffusion 3.5 that establishes trigger-indexed memory as a modular interface for adding targeted visual evidence without rewriting the generator.
Hao-Ran He, Run-Yuan Cai, Yi-Ming Wang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.