Skip to content

A Roadmap for MEG Foundation Models

Sep 2026 · 0 citations · 47 references
Biology Computer Science

TL;DR

This perspective lays down the basic concepts needed to understand MEG foundation models and provides a didactic overview of the field's key design choices, including tokenization, sensor- versus source-space representations, sensor-geometry encoding, backbone architectures, self-supervised objectives, and pretraining data.

Abstract

Foundation models are beginning to reshape brain-signal analysis by moving the field beyond task-specific decoding pipelines toward reusable models pretrained on broad neural datasets. Magnetoencephalography (MEG) is a compelling but still underdeveloped target for this shift: it captures human cortical dynamics at millisecond resolution while offering stronger spatial interpretability than EEG, making it especially valuable for source-resolved studies of perception, language, cognition, and clinical brain function. Yet MEG foundation models remain at an early stage, with only a small number of MEG-specific and MEG-inclusive multi-modal models, modest pretraining corpora, and emerging but still limited benchmarks. This perspective lays down the basic concepts needed to understand MEG foundation models and provides a didactic overview of the field's key design choices, including tokenization, sensor- versus source-space representations, sensor-geometry encoding, backbone architectures, self-supervised objectives, and pretraining data. We then offer a roadmap for future development, organized around native MEG pretraining, adaptation of EEG foundation models, transfer from generic time-series models, and multi-modal integration with EEG, fMRI, MRI, behaviour, and stimulus features. We highlight the need for coordinated infrastructure, including diverse and reusable MEG datasets, rigorous evaluation across subjects, sites, tasks, and clinical settings, and responsible data-sharing practices that address consent, privacy, access, and governance.

View source

Similar papers

Preprint Sep 2026

BrainTaskonomy: Learning How to Pretrain and What to Transfer in fMRI Foundation Models

fMRI foundation models increasingly aggregate heterogeneous data across brain states, cohorts, and acquisition settings, yet pretraining domains are commonly treated as a flat mixture and downstream tasks are adapted independently. We study whether measured learning relations can organize both stages without modifying...

Jun-Feng Xia, Wen-Hao Ye, Jun-Xiang Zhang et al. · 1 citation
#machine learning Preprint Sep 2026

What masking geometry works best for EEG foundation models?

EEG foundation models hold promise for scalable brain-signal decoding across clinical and cognitive neuroscience applications, yet their pre-training pipelines remain poorly understood. Among design choices, the masking strategy is particularly critical: it determines what the network must predict and from which contex...

Pierre Guetschel, B. Aristimunha, Y. El Ouahidi et al. · 0 citations
Preprint Sep 2026

FlatClip: A Geometry-Aware Surface-Level Baseline for fMRI Representation Learning

Recent fMRI foundation models differ substantially in the spatial scale at which they represent brain activity. ROI- and connectivity-based models are efficient but coarse, whereas voxel-level models preserve fine-grained spatial structure but require specialized 3D/4D architectures and costly fMRI-specific pretraining...

Mo Wang, Wen-Hao Ye, Zi-Han Ning et al. · 0 citations
Open access Aug 2026

MRI-free OPM-MEG recovers medial temporal lobe theta during scene imagination

Optically pumped magnetometer magnetoencephalography (OPM-MEG) offers a wearable, movement-tolerant alternative to conventional cryogenic MEG, placing sensors closer to the scalp and, in principle, improving sensitivity to deep sources. This is advantageous for examining subcortical structures that are affected by agei...

Conor Thornberry, Prathiksha Math, Margarida Cohen Serra et al. · 0 citations
#machine learning Preprint Sep 2026

A Scaling Study for fMRI Foundation Models

Scaling laws have guided large-model development in computer vision and natural language processing, but the relationships among data, model size, and compute remain unclear for functional magnetic resonance imaging (fMRI) foundation models. Here, we conduct a controlled empirical study using pretraining data from more...

Wen-Hao Ye, Xuan-Ye Pan, Jun-Feng Xia et al. · 0 citations
Preprint Aug 2026

Interpretable MEG Decoding of Perceived Speech: Cortical Sources and the Stimulus Features That Drive Retrieval

Paired MEG occlusion shows that 15 of 19 stimulus features contribute, with the largest effects for silence, sound intensity, vowels, and acoustic onsets, indicating that activity without narrative structure carries less recoverable information than activity during coherent speech.

Ilia Semenkov, Daria Kleeva, I. Dakhtin et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.