Aug 2026· IEEE Transactions on Image Processing· Vol 35, pp. 9359-9371· 0 citations· 50 references
MedicineComputer Science
Abstract
Mamba, a global context modeling paradigm with a selective scanning mechanism, has recently attracted increasing attention in multimodal image fusion. Multimodal fusion aims to preserve and enhance cross-modal complementary information to produce high-quality fused images. Despite its suitability, existing Mamba-based fusion methods often blur modality-specific feature boundaries, mine complementary cues insufficiently, and lack explicit modal-specific modeling. To address these limitations, inspired by cross-attention, we extend Mamba to a multimodal setting and propose a Cross-Mamba architecture. As a plug-and-play module, Cross-Mamba adaptively mines inter-modal complementary information via cross-modal screening, thereby strengthening cross-modal interactions. Moreover, to emphasize complementary cues, reduce redundancy, and lower aggregation complexity, we impose rank constraints to preserve the spatial low-rank structure of features, retaining more informative components and improving fusion quality. Finally, we introduce a masked semantic guidance mechanism to narrow the semantic gap between fusion and downstream tasks, enhancing downstream adaptability. Extensive experiments on multiple fusion datasets, including qualitative, quantitative, and ablation studies, demonstrate that our method achieves state-of-the-art performance.
Effective multimodal image fusion is important for enhancing scene representation in applications such as video surveillance and medical diagnosis. However, directly fusing source images with insufficient clarity often causes detail loss and information mixing, which degrades the final fusion quality. To address this i...
Unknown authors· Journal of Electronic Imagin...· 0 citations
Object detection using visible–infrared images has become increasingly important for all-day detection scenarios. However, due to significant imaging discrepancies between the visible and infrared modalities, achieving accurate modal alignment and effective feature fusion remains a major challenge. Existing methods oft...
Kai-Yue Men, Cheng-You Wang, Xiao Zhou et al.· IEEE Transactions on Geoscie...· 0 citations
Remote sensing image segmentation serves as a fundamental step in connecting raw data with high-level vision understanding. However, single-modality inputs, such as optical or SAR imagery, often provide incomplete semantics, thereby limiting segmentation accuracy. While recent state space models (e.g., Mamba) have show...
Multi-modality image fusion (MMIF) seeks to generate images that are suitable for human viewing while also supporting downstream visual understanding. Existing approaches usually learn fusion and segmentation together, either through cascaded task supervision or by exchanging intermediate features. In most cases, howev...
Cheng-Chao Wang, Xue Wang, Hao-Yu Xiong et al.· Proceedings of the 34th ACM...· 0 citations
Hyperspectral images (HSIs), with their hundreds of contiguous narrow bands, capture detailed physicochemical properties of land covers; LiDAR provides high-precision 3-D spatial and geometric structure, and the two modalities are highly complementary. However, differences in imaging mechanisms lead to insufficient cro...
Shu-Fang Xu, Wei-Wen Xu, Qi-Yuan Xue et al.· IEEE Transactions on Geoscie...· 0 citations
Existing fusion methods integrate complementary information from source images to generate a mixed-modality fused image, causing visually ambiguous representations that degrade downstream task performance (e.g., segmentation and detection). Therefore, we rethink infrared and visible image fusion from a modality-invaria...
He Cui, Wen-Da Zhao, Hai-Peng Wang et al.· IEEE Transactions on Image P...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.