Skip to content

Diversifying Similar Subjects for Text-to-Image Synthesis with Self-Cross Diffusion Guidance and Reward

Jul 2026 · International Journal of Computer Vision · Vol 134 · 0 citations · 64 references
Computer Science

TL;DR

This training-free method improves the performance of both U-Net-based and Transformer-based diffusion models, including the Stable Diffusion series and FLUX series and adapts self-cross guidance as an effective reward for RL-based post-training and show improved subject diversity with no computational overhead at inference time.

View source

Similar papers

Multi-Axis Max@K Reinforcement Learning for Representative Diversity in Text-to-Image Generation

This work formalizes target-mode coverage as target-mode coverage, the coverage of a predefined set of semantically specified modes, and proposes multi-axis max@K, a group-based reinforcement learning objective for improving it in diffusion-based T2I models.

Ku Onoda, Paavo Parmas, Hiroki Furuta et al. · 3 citations
Conference Aug 2026

Regional self-attention for layout-to-image diffusion: resolving overlap, scale, and semantic misalignment

The Regional Self-Attention Mechanism is proposed, which strictly confines the self-attention operation to the independent regions defined by the target bounding boxes, enabling the model to generate specific-category targets in a targeted manner during the denoising process.

Haoshu Zhao, Xi Zhang · 0 citations
Conference Jul 2026

Dual-path attention modulation for training-free text-guided image editing

A training-free Dual-path Attention Modulation (DAR) framework that decouples semantic edits while preserving source image structure is proposed and Adaptive Self-Attention (ASA) and Adaptive Cross-Attention (ACA) modules that dynamically regulate attention replacement are introduced.

Tong Cui, Jie Yang, Kai-Ru Li et al. · 0 citations
Open access Aug 2026

In-Loop Model Adaptation with Coupled Latent-Noise Guidance for High-Fidelity Subject-Driven Text-to-Image Generation

Text-to-image diffusion models have achieved remarkable success in generating high-quality images from a given text prompt. Subject-driven generation aims to synthesize customized images to mimic the appearance of subjects in given reference images within different visual contexts specified by the text prompts. The cen...

Yushun Tang, Weiming Chen, Siyi Liu et al. · 0 citations
Preprint Aug 2026

CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets

Subject-driven image personalization---generating new images that preserve the identity of one or several reference subjects in novel scenes---is a foundational capability for modern visual content creation. It is currently dominated by generalized methods that fine-tune a pretrained multimodal diffusion transformer (M...

Jihun Park, Kyoungmin Lee, Jongmin Gim et al. · 0 citations
Review Open access Jul 2026

Text-to-Image Generation via Deep Learning: A Comprehensive Review of Models, Architectures, and Future Directions

The paradigms of the generative adversarial networks (GANs), variational autoencoders (VAEs), transformer-based designs, and diffusion models, with the last one representing the state of the art in image generation models are discussed.

Abdussalam Elhanashi, Siham Essahraui, Qinghe Zheng et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.