Skip to content

Contrastive supervision and denoising gated fusion for masked graph-based multimodal emotion recognition

Aug 2026 · Multimedia Systems · Vol 32 · 0 citations · 35 references

TL;DR

A gated fusion mechanism incorporating a denoising feed-forward network is employed to effectively suppress intra-modal noise in audio and visual streams while achieving interactive multimodal affective fusion and masked graph learning is utilized to model conversational context among speakers, deeply capturing emotional dynamics and integrating multimodal affective information.

View source

Similar papers

Book Open access Oct 2026

ADMC: Attention-based Diffusion model for Missing modalities Completion

Multimodal emotion and intent recognition is essential for automated human-computer interaction, and it aims to analyze users’ speech, text, and visual information to predict their emotions or intent. One of the significant challenges is modality missingness caused by sensor malfunctions or incomplete data. Traditional...

Yu-Hang Li, Wei Zhang, Juan Chen et al. · 0 citations
Aug 2026

Bidirectional joint cross-attention framework for transformer based audio–visual emotion recognition

Experiments show that the proposed framework outperforms unimodal baselines and existing fusion methods, indicating that the approach learns context-aware emotion representations well suited for accuracy-oriented audio–visual emotion recognition applications.

Arman Sajjadi, M. Nekou, Sayna Sarvar et al. · 0 citations
Conference Aug 2026

Multimodal Emotion Recognition with Emotion-Specific Cross-Modal Attention Blocks

Multimodal emotion recognition is increasingly important for healthcare, education, and human-computer interaction. However, many existing systems learn a single shared representation for all emotions, which can blur subtle class-specific cues. This paper proposes an emotion-specific multimodal architecture that combin...

Gnanaseelan Dharshika, A. Ramanan · 0 citations
Open access Aug 2026

Adaptive Reliability-Guided Multimodal Learning Framework for Robust Emotion and Sentiment Classification Under Noisy and Missing Modalities

The Adaptive Reliability-Guided Multimodal Artificial Intelligence system outperforms existing state-of-the-art multimodal learning algorithms under noisy and missing modality situations and provides consistent convergence and enhanced generalisation for real-world affective computing applications.

S. V · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.