2026· IEEE Transactions on Geoscience and Remote Sensing· Vol 64, pp. 5408513-5408513· 0 citations· 63 references
TL;DR
CFIMNet is proposed, a cross-modal frequency-guided iterative multiscale feature fusion (IMFF) network that improves feature complementarity and multiscale representation for RGB–infrared remote sensing object detection and improves semantic consistency while preserving modality-specific characteristics.
Abstract
Multimodal object detection can improve detection accuracy and robustness by fusing complementary information from different modalities. However, in remote sensing scenarios, complex environments often weaken data reliability and cross-modal complementarity, making fixed-pattern fusion strategies insufficient for robust and accurate detection. To address these challenges, this article proposes CFIMNet, a cross-modal frequency-guided iterative multiscale feature fusion (IMFF) network that improves feature complementarity and multiscale representation for RGB–infrared remote sensing object detection. Specifically, a cross-modal frequency enhancement (CFE) module is designed to model channel–spatial interactions between RGB and infrared features and enhance structural information and fine-grained details through adaptive frequency decomposition and reconstruction. In addition, an IMFF module is introduced to progressively fuse cross-modal features across multiple scales within a parameter-shared iterative framework, thereby improving semantic consistency while preserving modality-specific characteristics. Extensive experiments on three benchmark remote sensing datasets demonstrate that CFIMNet consistently outperforms the state-of-the-art methods in detection accuracy and robustness. Code will be available at https://github.com/MapleMoonY/CFIMNet
Object detection using visible–infrared images has become increasingly important for all-day detection scenarios. However, due to significant imaging discrepancies between the visible and infrared modalities, achieving accurate modal alignment and effective feature fusion remains a major challenge. Existing methods oft...
Kai-Yue Men, Cheng-You Wang, Xiao Zhou et al.· IEEE Transactions on Geoscie...· 0 citations
The hyperspectral image (HSI) and light detection and ranging (LiDAR) data provide complementary characteristics that improve the performance of remote sensing image classification. However, the existing multimodal fusion methods still struggle against two critical challenges. First, most cross-modal fusion strategies...
Ping Li, Qi-Ya Song, Jian-Le Peng et al.· IEEE Transactions on Geoscie...· 0 citations
Multi-source remote sensing image classification benefits from complementary spectral and structural information. However, identifying discriminative cross-modal features remains challenging. This letter proposes a Cross-Layer Refinement and Frequency-aware Fusion Network (CRFNet) within a lightweight dual-branch archi...
Wen-Han Xiao, Chuan-Zheng Gong, Feng Gao et al.· 0 citations
Multimodal remote sensing object detection benefits from the complementary characteristics of visible and infrared modalities. However, owing to the heterogeneous imaging mechanisms of RGB and infrared sensors, feature representations from the two modalities progressively become semantically inconsistent during hie...
The visible-infrared object detection in uncrewed aerial vehicle (UAV) remote sensing remains challenging due to small object feature degradation, complex-background interference, modality heterogeneity, and the high computational cost of existing fusion methods. To address these issues, this study proposes a multimoda...
Ding-Xin Tang, Wen-Qing Yang, J. Xuan· IEEE Transactions on Geoscie...· 1 citation
R2F-YOLO is proposed, a dual-modality detection network that fuses RGB and thermal infrared imagery for wildfire flame detection and achieves the best overall result among the methods evaluated under the same RGBT-3 M protocol while maintaining real-time inference capability.
Hong-Qiao Wang, Xuan-Chen Yan, Hai-Yan Sun et al.· IEEE Journal of Selected Top...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.