Skip to content

Discriminative semantic learning for incomplete multimodal sentiment analysis

Aug 2026 · Multimedia Systems · Vol 32 · 0 citations · 40 references

TL;DR

The framework first introduces learnable sentiment prototypes as semantic anchors to provide explicit sentiment-discriminative guidance for feature completion, and a gradient decoupling strategy is designed to separate the optimization paths of unimodal and multimodal objectives, preventing fusion gradients from interfering with unimodal encoders, thereby synergistically enhancing both discriminative representation learning and multimodal fusion.

View source

Similar papers

Open access Aug 2026

Learning Adaptive Cross-Modal Interactions for Multimodal Sentiment Analysis

A framework for learning adaptive cross-modal interactions for multimodal sentiment analysis that consistently outperforms previous methods and enhances multimodal representation capability for sentiment classification is proposed.

Chuhan Cheng, Hangcheng Wu, Jun-Qiao Wang et al. · 0 citations
Conference Jul 2026

Sentiment-Intensity-Aware Contrastive Learning with Hierarchical Information Bottleneck for Multimodal Sentiment Analysis

In multimodal sentiment analysis, textual, acoustic, and visual modalities often contain redundant and noisy information. Such information increases model complexity and weakens core sentiment representations, degrading accuracy and robustness. To address this issue, we propose CLIBN, a multimodal sentiment recognition...

Xu Meng, Yi Zhang, Yang Li · 0 citations
Open access Aug 2026

Adaptive Reliability-Guided Multimodal Learning Framework for Robust Emotion and Sentiment Classification Under Noisy and Missing Modalities

The Adaptive Reliability-Guided Multimodal Artificial Intelligence system outperforms existing state-of-the-art multimodal learning algorithms under noisy and missing modality situations and provides consistent convergence and enhanced generalisation for real-world affective computing applications.

S. V · 0 citations
Preprint Aug 2026

Contrastive Mixed Prompt Learning for Incomplete Multimodal Sentiment Analysis with Unseen Modality Combination

This paper introduces the problem of Incomplete Multimodal Sentiment Analysis with Unseen Modality Combinations (IMSAUMC), aiming to enhance model generalization for unseen modality combinations, and introduces a label-guided contrastive feature learning mechanism to learn robust and discriminative cross-modal represen...

Kaixin Xu, Nai-Jing Liu, Yu-Ri Kang et al. · 0 citations
Conference 2026

Hierarchical Global-Local Interaction and Refinement for Multimodal Sentiment Analysis

A Modality Dropout strategy is first introduced at the input stage to alleviate over-reliance on a sin-gle modality and improve robustness and the proposed Hierarchical Global-Local Interaction and Refinement framework for Multimodal Sentiment Analysis (HGLIR) is proposed.

yuanyuan zhou · 0 citations
Open access 2026

RUAL: Uncertainty-Aware Learning for Robust Multimodal Sentiment Analysis

Experimental results demonstrate that RUAL achieves strong overall performance and maintains stable prediction results under missing-modality and Gaussian-noise conditions, validating the effectiveness and robustness of the proposed framework for multimodal sentiment analysis.

Wei-Hong Gao, Zi-Yang Zhang, Maotang Su · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.