Experiments on the IEMOCAP and MELD datasets show that Diff-IGAT significantly outperforms baseline methods, demonstrating its effectiveness in multi-party emotion recognition.
Multimodal emotion recognition in conversations aims to identify the emotion expressed in each utterance by jointly analyzing textual, acoustic, visual, and contextual information. However, existing methods still face challenges in coordinating intra-modal dependency modeling, cross-modal interaction, and graph-based c...
Jing Zhao, Feng Liu· Frontiers in Psychology· 1 citation
Transformer-GAT is proposed, a hybrid framework that combines Transformer and the Graph Attention Network to enable cross-modal emotion understanding and effectively integrates multimodal features, balances global and local contexts, and provides deeper emotional insights, offering new directions for multimodal emotion...
Conversational emotion recognition has become an essential research area for developing intelligent human–computer interaction systems capable of understanding contextual emotional dynamics from multimodal information. Existing transformer-based approaches mainly focus on local contextual dependencies while often overl...
S. V· Journal of Intelligent Decis...· 0 citations
Multimodal emotion recognition in conversation (MERC) aims to identify the emotions in each utterance by modeling textual, acoustic, and visual evidence. Compared with unimodal emotion recognition in conversation (ERC), MERC can leverage complementary textual, acoustic, and visual information to support more accurate a...
Xin-Yang Zhou, Jiahao Wu, Hong-Ming Xu et al.· Big Data and Cognitive Compu...· 0 citations
BiM-MFGCN, a bidirectional Mamba and multi-frequency graph convolutional network for multimodal ERC, is proposed, demonstrating its effectiveness for multimodal ERC.
Yi-Chi Dong, Jian-Bo Lu· Engineering Research Express· 0 citations