Unified heterogeneity-aware benchmark of drug synergy prediction: a cross-study analysis of traditional machine learning and graph deep learning models.
The first comprehensive benchmarking framework specifically designed to accommodate inter-dataset heterogeneity is presented, finding that well-designed small datasets can match or even surpass the performance of larger benchmarks, suggesting that different metrics are applicable to different datasets/testing scenarios.
Abstract
Drug synergy prediction holds great promise in accelerating combination therapy development and improving treatment efficacy in cancer and other complex diseases. However, progress in this area is hindered by considerable heterogeneity across experimental datasets, including variability in the number of drug combinations, inconsistencies in synergy scoring methodologies, and differences in data quality. Here, we present the first comprehensive benchmarking framework specifically designed to accommodate inter-dataset heterogeneity. This framework integrates 13 independent datasets encompassing 454,794 retained drug combination-cell line entries, 4247 drugs, and 187 cell lines, all of which are cancer cell lines. Our comparative evaluation of seven computational models for drug synergy prediction reveals that model performance strongly depends on both the scale and quality of the datasets. The graph model JointSyn performed favorably on datasets with larger numbers (> 10,000) of retained drug combinations, while the traditional random forest model performed competitively on smaller-scale datasets. We also observe that the ZIP scoring metric yields the highest accuracy in large-scale data, whereas HSA is more effective in sparse-data scenarios. However, different synergy metrics show significant variability in performance across datasets, suggesting that different synergy metrics capture distinct aspects of drug interactions, and the choice of metric can substantially affect model evaluation and cross‑dataset consistency. Furthermore, we find that well-designed small datasets can match or even surpass the performance of larger benchmarks, suggesting that different metrics are applicable to different datasets/testing scenarios. Our benchmark provides a robust foundation for fair model evaluation and paves the way for the development of more generalizable and preclinically relevant drug synergy prediction methods.
This work substantially expand the IMPROVE benchmark through large-scale integration of pharmacogenomic data, primarily from PharmacoDB, together with additional smaller data sources, which includes millions of drug response measurements, broader multi-omics coverage, and a major increase in chemical diversity, adding more than 50,000 compounds.
Vincent Lavelle, Yitan Zhu, Kaitlyn Marlor et al.· 0 citations
Drug combination therapy can improve the treatment of complex diseases through multi-target intervention, but the number of candidate combinations expands rapidly with the size of the drug space, making purely high-throughput screening insufficient for research and clinical needs. Network medicine provides biological priors for assessing the rationale of combinations by integrating protein-protein interaction networks, disease modules and drug-target topology, whereas artificial intelligence can learn nonlinear features from heterogeneous data such as chemical structures, targets, omics profiles and cellular phenotypes. This review summarizes recent progress in drug combination synergy prediction based on network medicine and artificial intelligence. It compares network topology methods, conventional machine learning, graph neural networks and multimodal fusion models in terms of principles, applicable scenarios and limitations, and discusses their translational value in cancer, hypertension and other complex diseases. Current studies remain constrained by data sparsity, negative-sample bias, insufficient model interpretability and limited prospective validation. Future work should strengthen standardized data integration, mechanism-constrained modeling and joint dose-timing optimization to improve interpretability, generalizability and clinical usability.
Haoyang Su· Applied and Computational En...· 0 citations
Drug sensitivity prediction is an important issue within the precision medicine field. IC50, which is the molar drug dose needed to decrease the viability of cells by half compared to the drug-free control, is the main pharmacodynamics parameter used for drug sensitivity analysis in large-scale pharmacogenomics screenings. Computational estimation of IC50s based on molecular and genomic factors significantly reduces costs associated with experiments for measuring cell viability and allows for accelerating the process of drug discovery. Traditional methods of IC50 calculation do not allow integrating the three-dimensional chemical structure of drugs and the biological context of particular cell lines, resulting in suboptimal model performance when using different pharmacogenomics data sources. In this work, we propose an innovative dual-branch approach based on Graph Isomorphism Network (GIN) drug representations coupled with a Multilayer Perceptron (MLP) for 50-dimensional ssGSEA pathway activities calculated from CCLE gene expression. After training on cell-line-drug pair combinations from the Genomics of Drug Sensitivity in Cancer 2 (GDSC2) dataset across various cancers, the proposed GIN+Pathway MLP model attains an R2 of 0.8553 and a Pearson Correlation Coefficient (PCC) of 0.9249 on the testing split of the same dataset. In a variant ablation study of six variants, we find that eliminating the pathway MLP component lowers the R2 value by more than 0.15, thus proving the importance of biological features in the two-branch model. The performance of our proposed model exceeds benchmark scores for models such as GraphDRP (PCC = 0.870, R2 = 0.756) and DeepCDR (PCC = 0.847, R2 = 0.720) when tested on the same GDSC2 dataset.
Drug-drug interaction (DDI) event prediction is critical for ensuring patient safety and optimizing therapeutic outcomes. Existing computational approaches are limited by their inability to jointly model the heterogeneous mechanisms underlying DDIs, which span molecular structure, pharmacodynamic function, and network-mediated relations. To address this limitation, we introduce M2DDI, a unified framework for dynamic multimodal fusion in DDI prediction. M2DDI utilizes a Mixture-of-Experts architecture, with each expert dedicated to a distinct pharmacological modality. A novel prior-enhanced dual-path gating strategy adaptively selects relevant experts for each drug pair by integrating mechanism-matched feature queries and ATC-based biomedical priors, thereby aligning expert selection with underlying pharmacological mechanisms and addressing the challenge of data incompleteness. Empirical evaluation on benchmark datasets demonstrates that M2DDI achieves state-of-the-art performance, particularly in new drug scenarios. Additional robustness experiments show that M2DDI maintains high predictive accuracy even when modality-specific information is partially missing, outperforming existing methods under similar conditions. Analysis of expert selection patterns further confirms alignment with established pharmacological mechanisms. These results establish M2DDI as an effective and mechanism-aware solution for comprehensive DDI prediction. The code is available at: https://github.com/RunqingXuCn/M2DDI.
Runqing Xu, Siyi Liu, Haoyang Li et al.· Proceedings of the 32nd ACM...· 0 citations
Abstract Motivation Accurate prediction of synergistic drug combinations can accelerate anticancer combination discovery. Existing methods inadequately model higher order drug–drug–cell-line interactions and drug–disease associations and remain sensitive to sparse and noisy multiomics data, limiting generalization to unseen cell lines and drug combinations. Results We present Momentum Contrast (MoCo)-MultiSynergy, a multimodal framework that combines modality-specific momentum contrastive learning with heterogeneous hypergraph modeling. The hypergraph represents synergistic drug–drug–cell-line triplets and drug–disease associations, while gated residual propagation refines node representations. MoCo modules regularize encoded drug and cell-line representations using latent feature masking and Gaussian perturbation. On the O’Neil and NCI-ALMANAC datasets, MoCo-MultiSynergy achieves the highest AUROC and AUPRC across the evaluated settings, with the largest gains when generalizing to unseen cell lines and drug combinations. Availability and implementation Source code is available at https://github.com/27167199/MoCo-MultiSynergy.
Yunxia Gu, Xindi Huang, Lifen Shi et al.· Bioinformatics· 0 citations