Nov 2026· Cognitive Computation· Vol 18· 0 citations· 187 references
TL;DR
This survey reviews KG-based emotion recognition and related affective tasks, covering knowledge extraction and graph construction, unimodal and multimodal systems, representation learning, reasoning, and integration with large language models (LLMs).
Abstract
Emotion recognition (ER) aims to identify affective states from facial expressions, speech, text, and physiological signals. The context-dependent and multimodal nature of emotion presents challenges for systems that rely on statistical associations alone. Knowledge graphs (KGs) organize affective concepts and their relations, providing explicit knowledge for contextual modeling, multimodal integration, and reasoning. This survey reviews KG-based emotion recognition and related affective tasks, covering knowledge extraction and graph construction, unimodal and multimodal systems, representation learning, reasoning, and integration with large language models (LLMs). The synthesis draws on 49 core studies and uses additional literature for theoretical and methodological context. It distinguishes semantic KGs from computational graphs and characterizes graph construction along five dimensions: knowledge scope, semantic foundation, construction mechanism, human involvement, and multimodal representation. Selected within-study comparisons report gains from enabling knowledge-related components, while differences in tasks, protocols, and comparison designs limit conclusions across systems. The survey also examines evaluation datasets, knowledge quality, and the computational and grounding challenges of LLM and KG integration. It identifies research priorities in knowledge validation, cross-domain generalization, privacy, temporal modeling, and multimodal alignment, with evaluation procedures for assessing their contribution to reliable affective systems.
Emotion recognition in artworks remains challenging because affective meaning is often subjective, implicit, and shaped by relationships between visual form and semantic associations. While vision-language models provide strong multimodal representations, direct image-to-emotion prediction may overlook explicit relatio...
Ngoc-Duy Mai, Ha-Thanh Nguyen, Hideaki Takeda· 0 citations
A modified DistilBERT that incorporates lexical emotion representations into the transformer pipeline via a feature fusion layer with attention weighting is proposed, which enables the joint learning of semantic dependencies, lexical cues, and text embeddings, which enhances the recognition of underrepresented emotions...
Manjog Padhy, Rasmita Rautray· International Journal of Mac...· 0 citations
This research introduces a Hybrid Attention Learning with Graph Convolutional Network for Text-Based Emotion Detection (HALGCN-TED) framework, aiming to develop a robust and automated model to improve the representation and detection of complex emotional patterns.
Mohammad A. Mahzari, Noah N. Alsager, A. Hilal· Research Journal in Advanced...· 0 citations
Implicit emotion understanding addresses a fundamental yet underexplored challenge: observable expressions do not always faithfully reflect underlying emotional states, requiring models to infer latent emotions from limited multimodal signals. Existing approaches largely assume direct correspondence between overt cues...
Ke-Han Wang, Huan Zhao, Guang-Hui Ye et al.· Proceedings of the 34th ACM...· 0 citations
The virtualized nature of online English instruction weakens affective interaction between teachers and learners. This study proposes a multimodal dialogue emotion recognition method based on a semantic-enhanced graph and develops an emotion classification framework optimized for the unique multimodal noise and implici...
Xiao-Li Huang, A. Cheema· PeerJ Computer Science· 0 citations
CMES (Cross-Modal Emotion Stimuli), a multi-source collection of emotion-conditioned stories, real facial expressions, synthetic portraits, and synthetic emotion-evoking scenes, suggests that emotion representations can share relational structure and causal effects across sources, modalities, and architectures, even wh...