Aug 2026· Multimedia Systems· Vol 32· 0 citations· 35 references
TL;DR
A gated fusion mechanism incorporating a denoising feed-forward network is employed to effectively suppress intra-modal noise in audio and visual streams while achieving interactive multimodal affective fusion and masked graph learning is utilized to model conversational context among speakers, deeply capturing emotional dynamics and integrating multimodal affective information.
Multimodal emotion and intent recognition is essential for automated human-computer interaction, and it aims to analyze users’ speech, text, and visual information to predict their emotions or intent. One of the significant challenges is modality missingness caused by sensor malfunctions or incomplete data. Traditional...
Yu-Hang Li, Wei Zhang, Juan Chen et al.· 0 citations
Experiments show that the proposed framework outperforms unimodal baselines and existing fusion methods, indicating that the approach learns context-aware emotion representations well suited for accuracy-oriented audio–visual emotion recognition applications.
Arman Sajjadi, M. Nekou, Sayna Sarvar et al.· Signal, Image and Video Proc...· 0 citations
Multimodal emotion recognition is increasingly important for healthcare, education, and human-computer interaction. However, many existing systems learn a single shared representation for all emotions, which can blur subtle class-specific cues. This paper proposes an emotion-specific multimodal architecture that combin...
Gnanaseelan Dharshika, A. Ramanan· Moratuwa Engineering Researc...· 0 citations
The Adaptive Reliability-Guided Multimodal Artificial Intelligence system outperforms existing state-of-the-art multimodal learning algorithms under noisy and missing modality situations and provides consistent convergence and enhanced generalisation for real-world affective computing applications.
S. V· Journal of Intelligent Decis...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.