Experiments show that MHG-FM outperforms several state-of-the-art baselines in reconstruction quality, topology preservation, distributional similarity, and SC-FC coupling, while achieving approximately 8x faster sampling than a matched diffusion backbone.
Abstract
Structural connectivity (SC) and functional connectivity (FC) provide complementary information on interactions between brain regions and are widely used in neuroimaging studies of neuropsychiatric disorders. Generative modelling can alleviate the scarcity of large-scale paired SC-FC data, but existing approaches typically use pairwise graphs that capture only dyadic interactions and often generate SC and FC independently, limiting preservation of higher-order structure-function relationships. We propose a Multimodal Hypergraph Flow Matching (MHG-FM) framework for joint SC-FC connectivity generation and cross-modal translation. MHG-FM constructs modality-specific hypergraphs, learns higher-order representations with Hypergraph Neural Network (HGNN) encoders, and performs bidirectional cross-modal fusion using Dual Cross-Attention (DCA). A variational autoencoder maps the fused representations to a compact latent space, where conditional flow matching enables connectivity synthesis and multimodal translation via latent transport. Experiments on the Human Connectome Project Young Adult (HCP-YA) dataset show that MHG-FM outperforms several state-of-the-art baselines in reconstruction quality, topology preservation, distributional similarity, and SC-FC coupling, while achieving approximately 8x faster sampling than a matched diffusion backbone.
A novel Graph Convolutional Pre-trained Contrastive Cross-Fusion (GPC-CF) framework, which integrates EEG and fMRI data within a pre-training and fine-tuning model to establish a powerful paradigm for multimodal brain signal fusion.
Rui-Zhe Zhong, Hai-Sheng Li, Min Zuo et al.· IEEE Access· 0 citations
Resting-state functional magnetic resonance imaging (rs-fMRI) serves as a widely used non-invasive brain imaging tool for investigating neurological disorders through functional brain networks (FBN) modeling among brain regions of interest (ROIs). Deep learning frameworks, notably graph neural networks and Transformers...
Li-Na Zhou, Yue-Ying Zhou, Yun-Ling Ma et al.· IEEE journal of biomedical a...· 0 citations
Functional magnetic resonance imaging (fMRI) commonly characterizes large-scale brain organization through functional connectivity (FC). However, an observed FC matrix is not a fixed brain graph but a statistical estimate determined by the finite BOLD frames used to compute it. Conventional FC-based approaches typicall...
Zi-Teng Sui, Jun-Feng Xia, Wen-Hao Ye et al.· 0 citations
Multi-modal fusion methods have demonstrated potential in integrating complementary information from different data modalities. However, existing methods often rely on static fusion strategies, failing to capture the heterogeneous interactions across modalities. To address this challenge, we propose the dynamic multi-s...
High-resolution dynamic functional connectivity (DFC) can reveal rapidly evolving brain-network interactions, but short temporal windows yield noisy, often low-rank covariance estimates. Graph-Variate Dynamic (GVD) connectivity addresses this by modulating fast instantaneous interactions with stable trial-level support...
Om Roy, Yashar Moshfeghi, K. M. Smith· 0 citations
Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.
Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.
MIT News · Artificial Intelligence· news.mit.eduOct 28, 2026
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.