Skip to content

Graph Neural Network and Transformer Fusion for Molecular Property Prediction: What a Strict Evaluation Protocol Finds

Sep 2026 · Zenodo (CERN European Organization for Nuclear Research)

Abstract

An evaluation protocol for multi-view molecular property prediction, and a fusion architecture measured under it. Eight MoleculeNet datasets, six scaffold splits (the DeepChem canonical split plus five seeded), paired comparisons with Holm correction and an across-dataset test, split-conformal uncertainty (LAC, APS, RAPS, class-conditional, CQR), and machine-checked reproducibility gates that fail the build when a number, a config or a featuriser drifts. The results are largely negative and are reported as such: the proposed fusion architecture does not beat a fingerprint-plus-descriptor MLP (4 of 8 datasets, p = 0.55); a 16,513-parameter gate matches a 1,169,793-parameter fusion block; roughly eleven GPU-hours of LoRA adaptation buy nothing over a cached frozen embedding; two published external baselines (AttentiveFP, Chemprop) are statistically indistinguishable from a two-layer graph network; a nominal 90% conformal guarantee covers 9.7-14.1% of active compounds for three of fifteen models, with mean prediction-set size predicting which; a fully seeded pipeline moved to a different GPU is a different model, moving 18% of single-split numbers by more than the field's reported effect sizes; and the significance of the paper's own mechanism claim is not stable to an architectural constant that does not otherwise matter. The baseline pipeline is the author's own earlier work, preserved runnable so that claims about fixing its evaluation are checkable against archived predictions.

View source

Similar papers

#computer vision Conference Aug 2008

Scrum in a Multiproject Environment: An Ethnographically-Inspired Case Study on the Adoption Challenges

Agile methods continue to gain popularity. In particular, the Scrum method appears to be on the verge of becoming a de-facto standard in the industry, leading the so called Agile movement. While there are success stories and recommendations, there is little scientifically valid evidence of the challenges in the adoptio...

A. Marchenko, P. Abrahamsson · 59 citations · ⚡11
#computer vision Open access Sep 2012

Making the leap to a software platform strategy: Issues and challenges

A comprehensive taxonomy of the challenges faced when a medium-scale organization decided to adopt software platforms is provided, namely: business challenges, organizational challenges, technical challenges, and people challenges.

Yaser Ghanam, F. Maurer, P. Abrahamsson · 41 citations · ⚡3
#machine learning Open access Mar 2024

Integration of molecular coarse-grained model into geometric representation learning framework for protein-protein complex property prediction

MCGLPPI, a novel geometric representation learning framework that combines graph neural networks (GNNs) with the MARTINI molecular coarse-grained (CG) model to predict overall PPI properties accurately and efficiently, offers an effective and efficient solution for PPI overall property predictions.

Yang Yue, Shu Li, Yihua Cheng et al. · 15 citations

PepPCBench is a Comprehensive Benchmarking Framework for Protein-Peptide Complex Structure Prediction

PepPCBench enables a robust evaluation of PFNN-based methods and supports their continued development for peptide-protein structure prediction, and highlights the influence of peptide length, conformational flexibility, and training set similarity on prediction accuracy.

Si-Long Zhai, Huifeng Zhao, Ji-Ke Wang et al. · 13 citations · ⚡1
#machine learning Open access Sep 2025

Unified and explainable molecular representation learning for imperfectly annotated data from the hypergraph view

OmniMol is presented, a framework using hypergraphs to improve predictions of molecular properties, addressing challenges of imperfect data annotation and enhancing model explainability, and achieves state-of-the-art performance in properties prediction.

Bowen Wang, Junyou Li, Donghao Zhou et al. · 11 citations

Related blog posts

Microsoft Research Blog Jul 13, 2026

Verifying Rust cryptography in SymCrypt, from standards to code

Cryptographic code supports vital protections in modern computing systems. Learn how a new method helps verify code as developers write it while preserving speed and adaptability as it gets implemented and evolves. The post Verifying Rust cryptography in SymCrypt, from standards to code appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.