FlowT-SR: A Novel Remote Sensing Image Super-Resolution Framework with Cloud Haze and Noise Suppression
TL;DR
A novel SR framework based on the flow matching paradigm and a diffusion transformer, named FlowT-SR, which achieves superior and reliable reconstruction quality by jointly mitigating sensor noise and thin cloud interference, achieving superior reconstruction performance compared with current state-of-the-art methods in terms of both PSNR and SSIM.
Abstract
Remote sensing image super-resolution (SR) aims to enhance spatial resolution and recover image details, which typically enhances the quality of optical remote sensing imagery. However, interference from cloud haze cover and sensor noise often leads to distorted details and artifacts in reconstructed images of conventional deep learning SR approaches, significantly limiting reconstruction fidelity. To address these challenges, we propose a novel SR framework based on the flow matching paradigm and a diffusion transformer, named FlowT-SR, which achieves superior and reliable reconstruction quality by jointly mitigating sensor noise and thin cloud interference. First, an evolution path from low-resolution images to ground-truth images is constructed based on the optimal transport displacement interpolation mechanism, and the corresponding vector field that governs this evolution is employed as the supervision signal for subsequent model training. Then, a multi-scale interference suppression (MSIS) module is combined with a novel diffusion transformer network (DiTNet) to predict the vector field. The MSIS module performs preliminary denoising and captures the spatial distribution of thin cloud and haze in low-resolution images, providing degradation-aware feature representations for DiTNet. Subsequently, a DiTNet is presented to predict the evolution vector field obtained in the first stage, which consists of ten layers based on the diffusion transformer. By accurately predicting the vector field at any time step, the model effectively reduces the impact of cloud haze and noise interference to improve the reconstruction precision. Finally, driven by the predicted vector field along the evolution path, the SR remote sensing image is generated through solving the corresponding ordinary differential equation, yielding cloud-free and noise-reduced results. Extensive experiments on our dataset and the public CUHK Cloud Removal dataset demonstrate that FlowT-SR effectively suppresses cloud haze and noise interference, achieving superior reconstruction performance compared with current state-of-the-art methods in terms of both PSNR and SSIM.