Skip to content
Preprint

Multimodal Molecular Representation Learning with Graph Neural Networks, Deep&Cross Networks, and SMILES Embeddings

Jul 2026 · 0 citations · 26 references
Computer Science

Abstract

Molecular property prediction often relies on isolated data modalities, where continuous 3D graph neural networks (GNNs) struggle to efficiently capture long-range topological dependencies and exact macroscopic heuristics. In this work, we introduce a parameter-efficient Tri-Branch Modular Fusion Neural Network that synthesizes three orthogonal modalities: 3D spatial geometry (SchNet), discrete topological grammar (SMILES via ChemBERTa), and explicit macroscopic physicochemical descriptors (Deep&Cross Network). By bypassing standard scalar readouts and employing a shared late-fusion architecture, the framework establishes a mathematically rigorous multimodal latent space that effectively resolves the arithmetic and oversmoothing limitations of local message passing. We evaluate the proposed architecture on the QM9 benchmark, targeting the extensive thermodynamic property of atomization energy at 0 K ($U_0^{\mathrm{atom}}$). Through systematic combinatorial ablation and latent bottleneck optimization ($d_e=64$), the tri-modal framework achieves a validation Mean Absolute Error (MAE) of 0.0207 eV. Operating with fewer than one million parameters, this architecture decisively surpasses the sub-chemical accuracy threshold and yields a substantial 20.6% error reduction over a strictly controlled geometric baseline. Ultimately, our findings demonstrate that integrating orthogonal macroscopic and topological data streams provides a synergistic, $\mathcal{O}(1)$ physical shortcut. This multimodal alignment offers a highly efficient alternative to brute-force parameter scaling, establishing a robust surrogate model for high-throughput virtual screening (HTVS) pipelines.

View source

Similar papers

Open access Jul 2026

Deep Learning for Molecular Property Prediction with Logical Background Knowledge

This work proposes an enhanced learning framework that deeply integrates structured logical knowledge within GNN models, and demonstrates that incorporating domain-specific relational knowledge leads to better generalization and robustness compared to standard GNNs.

Kai Hodžić, Gustav Šír · 0 citations
Aug 2026

Molecular Property Prediction via Sparse Binary Matrix Representation and Convolutional Neural Networks

The SBMR-CNN model demonstrates highly competitive accuracy, outperforming the CM, Uni-Mol+, and MPNN-2D benchmarks, while closely approaching the performance of the more computationally intensive MPNN-3D and SOAP descriptors, as well as the RF-MF model.

Abdulaziz W. Alherz, C. Tezak, Mohammed S. Alhajeri · 0 citations
Open access Jul 2026

Global graph features unveiled by unsupervised deep learning

Graphs provide a powerful framework for modeling complex systems, but their structural variability poses significant challenges for analysis and classification. To address these challenges, we introduce Graph Autoencoder Uncovering Descriptive Information (GAUDI), an unsupervised graph deep learning framework designed to capture both local details and global structure. GAUDI employs an hourglass architecture with hierarchical pooling and upsampling layers linked through skip connections, which preserve essential connectivity information throughout the encoding–decoding process. Even though identical or highly similar underlying parameters describing a system’s state can lead to significant variability in graph realizations, GAUDI consistently maps them into nearby regions of a structured and continuous latent space, effectively disentangling invariant process-level features from stochastic noise. We demonstrate GAUDI’s versatility across multiple applications, including small-world networks modeling, characterization of protein assemblies from super-resolution microscopy, analysis of collective motion in the Vicsek model, and identification of age-related changes in brain connectivity. Comparison with related approaches highlights GAUDI’s superior performance in analyzing complex graphs, providing new insights into emergent phenomena across diverse scientific domains.

Mirja Granfors, Jesús Pineda, Blanca Zufiria-Gerbolés et al. · 0 citations
Jul 2026

Multi‐Viewed Graph Representation Learning Through Graph Neural Network and Rich‐Spatial Local Feature Embedding

For many years, graph representation learning plays a pivotal role in bioinformatics and cheminformatics; as a result, supporting a wide range of tasks such as drug discovery, toxicity prediction, and compound–protein interaction analysis. However, existing approaches often focus solely on either sequential molecular fingerprints or graph‐based structural features, which limit their ability to capture both local chemical substructures and global molecular topology. To address this issue, we propose MM2Vec, a novel multi‐viewed molecular representation learning framework that integrates local rich‐feature embedding with graph neural network (GNN)‐based structural learning. Specifically, each molecular graph is first processed through an MLP‐based embedding layer that encodes sub‐structural fingerprint information extracted from radius‐based subgraphs, capturing fine‐grained chemical and physiochemical features. Simultaneously, a multi‐layered GNN encoder learns topological relationships from the molecular graph structure; therefore, focusing more on geometric and relational information among atoms. The outputs from both embedding branches are then fused using a learnable linear mechanism to produce unified, high‐quality molecular embeddings in a shared latent space. These fused representations are used to drive task‐specific prediction layers for addressing various learning objectives. We validate the proposed MM2Vec model on multiple graph learning tasks, including drug‐induced liver injury (DILI) classification and lethal dose (LD) molecular regression problems. Experimental results show that MM2Vec consistently outperforms classical machine learning (ML)‐based models and recent state‐of‐the‐art deep learning (DL)/GNN‐based methods in terms of accuracy, robustness, and generalization. Our findings in this highlight the importance of combining both sub‐structural and graph‐structural perspectives and demonstrate the versatility and effectiveness of our MM2Vec model for a wide range of molecular analysis tasks.

Phu Pham · 0 citations
Jul 2026

MSMPP: Molecular Property Prediction by Integrating Multi-scale Multi-view information with pretrained 3D molecular large model representation.

Molecular property prediction is a cornerstone for accelerating drug discovery, providing a computational way to alleviate the low success rate, high cost, and long development cycle of conventional pharmaceutical research and development. However, existing computational methods have obvious limitations: most current deep learning approaches rely on a single molecular view, failing to fully capture the multi-dimensional features of molecular structures; they mainly focus on intra-molecular features while ignoring inter molecular information and cross-task correlations; and limited labeled data severely impairs their generalization to novel molecules. To address these issues, we propose MSMPP, a multi-scale, multi-view fusion framework for molecular property prediction that learns intra- and inter scale features simultaneously. For intra-scale feature learning, MSMPP integrates TxGemma-enhanced 1D sequence representations, Graph Transformer-derived 2D topological graph features, and Uni-Mol-derived 3D molecular conformational features. The Graph Transformer models long-range atomic dependencies, while the two pretrained models provide task-agnostic molecular prior knowledge from large-scale pretraining corpora, thereby improving generalization to novel molecules. For inter-scale feature learning, MSMPP constructs an inter-molecular graph (IMG) that explicitly models global pairwise interactions among chemically similar molecules and also extracts the cross-task features. Evaluations on eight MoleculeNet datasets show that MSMPP significantly outperforms state-of-the-art models, demonstrating its effectiveness in integrating multi-view intra-molecular features, inter-molecular features and cross-task information. Overall, MSMPP provides a competitive tool for molecular property prediction and supports the acceleration of drug discovery workflows.

Jiongfeng Chen, Yulian Ding, Yan Yan et al. · 0 citations
Conference Jul 2026

GDGraph: Geometry-Enhanced Dual-View Graph for Molecular Representation Learning

Learning effective molecular representations is crucial for accurate property prediction in AI-aided drug discovery. However, most existing molecular pre-training methods are still primarily based on 2D topological graphs, limiting their ability to exploit 3D geometric information. Moreover, methods that do incorporate 3D geometry often do not distinguish between the roles of atom-centered and bond-centered representations. To address these limitations, we propose GDGraph, a geometryenhanced dual-view framework for molecular representation learning. GDGraph models molecular geometry from two complementary structural perspectives: an atom view for capturing global spatial dependencies and a bond view for modeling local geometric patterns. To support this dual-view design, we introduce a multi-scale geometric feature encoding scheme and a view-specific geometry-aware learning strategy, enabling each view to focus on the geometric dependencies it is best suited to capture. Extensive experiments demonstrate that GDGraph achieves strong and stable performance on molecular property prediction benchmarks, and effectively predicts geometrysensitive quantum chemical properties on the QM9 dataset.

Yu Liu, Jonathan D. Hirst, Jianfeng Ren et al. · 0 citations