Skip to content

Consistent Feature Transport for Image Relighting

Jul 2026 · arXiv.org · Vol abs/2607.17833 · 0 citations · 50 references
Computer Science

TL;DR

This work reformulates relighting as an illumination feature transport problem and introduces Consistent Feature Transport (CFT), a training principle that explicitly enforces illumination-consistent transport between source and target image distributions.

Abstract

Image relighting modifies illumination while preserving non-lighting content such as identity and geometry. Existing diffusion-based methods often suffer from unstable illumination changes or inconsistent content preservation under complex lighting, as they lack an explicit mechanism to learn feature transformations between images. We reformulate relighting as an illumination feature transport problem and introduce Consistent Feature Transport (CFT), a training principle that explicitly enforces illumination-consistent transport between source and target image distributions. Built upon rectified flow, CFT jointly models noise-to-image generation and illumination-consistent source-to-target transport through trajectory-level supervision. This dual-transport formulation encourages isolation of illumination-specific variations while preserving content-aligned features. To support complex lighting scenarios, we construct a large-scale portrait relighting dataset with diverse relighting effects. Experiments show consistent improvements over existing state-of-the-art relighting approaches and demonstrate that CFT can generalize to other editing tasks, including style transfer. Code is available at https://github.com/Dixin-Lab/CFT.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

RelightFormer: Feed-forward Generative Transformer for Multiview Object Relighting

Image relighting is traditionally tackled via complex inverse rendering pipelines, which suffer from ill-posed optimization, or single-image generative models that ignore crucial multi-view cues necessary for understanding 3D geometry and material interactions. To address these limitations, we introduce a feed-forward...

He-Jun Wang, Jin-Xi Li, Jun-Wei Jiang et al. · 0 citations
Preprint Aug 2026

Dior: Drawing the Light of Image via Material-Decoupled Illumination Representation

Controllable image relighting is an important problem in image editing, and hand-drawn scribbles provide an intuitive interface for specifying the desired illumination. However, existing methods do not establish a consistent and effective mapping between scribble inputs and relighting results, limiting their ability to...

Xuan-Pu Zhang, Xue-Song Niu, Hao-Xiang Cao et al. · 0 citations
Preprint Aug 2026

LumiTokens: 3D Relighting via Token-Space Lighting Transformation

LumiTokens is a framework that formulates 3D relighting as a direct transformation on latent scene tokens, without explicit 3D representations, rendering equations, or physics-based decomposition, and achieves comparable or superior relighting quality to other methods and supports progressive, composable lighting edits...

Yiwen Chen, Matheus Gadelha, Huai-Zu Jiang · 0 citations
Aug 2026

Illumination Explorer: All-Frequency Illumination Estimation via HEALPix-Guided Diffusion

Estimating panoramic illumination from a single limited-FOV input image is a critical yet challenging task for rendering realistic objects with complex materials in augmented reality. Existing methods typically either estimate parameterized lighting models or directly generate panoramas in an end-to-end manner. However...

Zhongyun Bao, Shiyuan Shen, Xiang-Qian Shen et al. · 0 citations
Preprint Sep 2026

Persistent Identity Preservation in Generative Image Models: A Benchmark and Evaluation System

Generative image models can now produce high-quality images, follow complex instructions, and support precise edits, but they still struggle to preserve who or what is being depicted. When generating or editing images of a specific subject, identity may drift as the pose, expression, appearance, viewpoint, or surroundi...

Meng-Wei Ren, Xuan-Er Zhang, Zhi-Hao Xia · 0 citations
Preprint Sep 2026

LightBridge: Feed-Forward Generative Relighting for 3D Gaussian Splatting

LightBridge is presented, a feed-forward generative framework for controllable relighting of complete 3DGS assets in a single pass and efficient single-pass prediction of complete relit 3DGS assets without scene-specific optimization.

Heng Cao, Pan-Hao Cheng, Huang-Sheng Du et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.