Jul 2026· International Conference on Pattern Recognition· pp. 322-338· 0 citations· 33 references
Computer Science
TL;DR
Adaptive Confidence-weighted Expansion (ACE), a novel framework to enhance the trustworthiness of multimodal fusion models, provides a more stable and robust data fusion method that facilitates the use of multimodal learning in addressing high-stakes problems.
Abstract
Multimodal learning is a robust approach to improve predictive performance in applications such as medical prognosis. However, the clinical applicability of models that use multimodal learning is hampered by their poor performance under noisy or uninformative data streams. Present fusion approaches often lack robust mechanisms for the dynamic assessment of data quality and for the provision of a trustable confidence score on the final prediction. This dissuades their deployment in safety-critical settings. To address these limitations, we introduce Adaptive Confidence-weighted Expansion (ACE), a novel framework to enhance the trustworthiness of multimodal fusion models. ACE first enhances the multimodal space by generating new, complementary modalities from intra-modality correlations. It then employs a dual-level confidence mechanism that (1) adaptively reweighs all modalities by their reliability before fusion and (2) estimates a global trust score over the fused, final decision. To evaluate ACE, we used four challenging multi-omics datasets (BRCA, KIPAN, LGG, and ROSMAP). ACE significantly outperforms existing state-of-the-art algorithms in both classification performance and confidence calibration. Our framework provides a more stable and robust data fusion method that facilitates the use of multimodal learning in addressing high-stakes problems.
REM-Fuse is introduced, an evidential deep learning framework in which per-source Dirichlet uncertainty adaptively weights each source through dual-channel weighting, asymmetric cross-scale enhancement, and Dempster–Shafer-inspired evidence accumulation that provides a compact reliability-aware fusion strategy for canc...
Yalu Huang, Yushuai Yuan, Wenbin Ye et al.· Mathematics· 0 citations
TIER-MoE is introduced, a risk-guided subspace mixture-of-experts model that defines sample-specific modality reliability as the prediction loss its unimodal predictor is expected to incur, and demonstrates its superiority over state-of-the-art methods in predictive performance and probability calibration.
A new confidence-aware hybrid design, CARE-LLM-GRAPH, which combines large language models (LLMs) to perform clinical reasoning, multimodal deep learning to analyze medical images, and population-aware graph intelligence to provide cohort-level information is presented.
Unknown authors· European Journal of Prosthod...· 0 citations
A novel MFL framework – Cascaded Unified Representation Learning for Efficient Fusion Network (CURE) – a lightweight and scalable framework that progressively integrates various modalities through a novel efficient Hybrid Geometry Aware Fusion layer (HyFuse), where each HyFuse layer is sequentially learned for each mod...
Joy Dhar, M. Pandey, Nayyar Zaidi et al.· Proceedings of the 32nd ACM...· 0 citations
This work proposes an uncertainty-aware multi-view dynamic decision framework for efficient and trustworthy disease classification that provides a scalable and practical solution for balancing diagnostic accuracy and economic cost, facilitating the deployment of multi-omics models in real-world clinical settings.
Yehong Huang, Huan Huang, Selena He et al.· Comput. Biol. Medicine· 0 citations
An explicit multimodal routing framework for clinical prediction that enables interpretable, robust, and auditable reasoning across three EHR modalities and introduces inference-time route masking, which simulates missing modalities and reweights the remaining routes without retraining.
Nikkie Hooman, Zhongjie Wu, Eric C. Larson et al.· IEEE/ACM International Confe...· 1 citation
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 14, 2026
Learn how Google DeepMind and GovTech Singapore uses lightweight on-device Gemma models to intercept conversational scams in private chats with zero cloud data egress.
MIT News · Artificial Intelligence· news.mit.eduOct 13, 2026
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
Microsoft Research Blog· microsoft.comOct 12, 2026
StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.