Skip to content

M3amba: Multi-Modality Mamba for Image Fusion

Aug 2026 · IEEE Transactions on Image Processing · Vol 35, pp. 9359-9371 · 0 citations · 50 references
Medicine Computer Science

Abstract

Mamba, a global context modeling paradigm with a selective scanning mechanism, has recently attracted increasing attention in multimodal image fusion. Multimodal fusion aims to preserve and enhance cross-modal complementary information to produce high-quality fused images. Despite its suitability, existing Mamba-based fusion methods often blur modality-specific feature boundaries, mine complementary cues insufficiently, and lack explicit modal-specific modeling. To address these limitations, inspired by cross-attention, we extend Mamba to a multimodal setting and propose a Cross-Mamba architecture. As a plug-and-play module, Cross-Mamba adaptively mines inter-modal complementary information via cross-modal screening, thereby strengthening cross-modal interactions. Moreover, to emphasize complementary cues, reduce redundancy, and lower aggregation complexity, we impose rank constraints to preserve the spatial low-rank structure of features, retaining more informative components and improving fusion quality. Finally, we introduce a masked semantic guidance mechanism to narrow the semantic gap between fusion and downstream tasks, enhancing downstream adaptability. Extensive experiments on multiple fusion datasets, including qualitative, quantitative, and ablation studies, demonstrate that our method achieves state-of-the-art performance.

View source

Similar papers

Nov 2026

Gaussian-MambaFuse: multimodal image fusion via Gaussian splatting and spatial-channel-aware Mamba

Effective multimodal image fusion is important for enhancing scene representation in applications such as video surveillance and medical diagnosis. However, directly fusing source images with insufficient clarity often causes detail loss and information mixing, which degrades the final fusion quality. To address this i...

Unknown authors · 0 citations
Open access 2026

MAMENet: Modal Alignment and Multiscale Feature Enhancement Network for RGB–IR Small Object Detection

Object detection using visible–infrared images has become increasingly important for all-day detection scenarios. However, due to significant imaging discrepancies between the visible and infrared modalities, achieving accurate modal alignment and effective feature fusion remains a major challenge. Existing methods oft...

Kai-Yue Men, Cheng-You Wang, Xiao Zhou et al. · 0 citations
Sep 2026

MNet: A Mamba-based teacher-student-decoder framework for multimodal remote sensing segmentation.

Remote sensing image segmentation serves as a fundamental step in connecting raw data with high-level vision understanding. However, single-modality inputs, such as optical or SAR imagery, often provide incomplete semantics, thereby limiting segmentation accuracy. While recent state space models (e.g., Mamba) have show...

Meng-Meng Liu, Rong-Hua Shang, Jing-Yu Zhong et al. · 0 citations
Book Open access Nov 2026

SDFMod: Semantics-guided Dynamic Frequency Modulation for Multi-modality Image Fusion

Multi-modality image fusion (MMIF) seeks to generate images that are suitable for human viewing while also supporting downstream visual understanding. Existing approaches usually learn fusion and segmentation together, either through cascaded task supervision or by exchanging intermediate features. In most cases, howev...

Cheng-Chao Wang, Xue Wang, Hao-Yu Xiong et al. · 0 citations
Open access 2026

MCESAN: A Modality Complementary Enhancement and Sparse Attention Network for Joint Hyperspectral and LiDAR Image Classification

Hyperspectral images (HSIs), with their hundreds of contiguous narrow bands, capture detailed physicochemical properties of land covers; LiDAR provides high-precision 3-D spatial and geometric structure, and the two modalities are highly complementary. However, differences in imaging mechanisms lead to insufficient cro...

Shu-Fang Xu, Wei-Wen Xu, Qi-Yuan Xue et al. · 0 citations
Sep 2026

RealFusion: Rethinking Infrared and Visible Image Fusion From a Modality-Invariant Perspective

Existing fusion methods integrate complementary information from source images to generate a mixed-modality fused image, causing visually ambiguous representations that degrade downstream task performance (e.g., segmentation and detection). Therefore, we rethink infrared and visible image fusion from a modality-invaria...

He Cui, Wen-Da Zhao, Hai-Peng Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.