ESCRAG-R1 is proposed, a unified framework that integrates retrieval-based psychological guidance into Group Relative Policy Optimization (GRPO) and transforms external knowledge into a robust learning signal that stimulates explicit internal reasoning prior to generation and fundamentally reshapes the model's internal policy.
Abstract
Emotional Support Conversation (ESC) systems aim to provide holistic support by balancing professional therapeutic competence with natural empathy. However, existing methods struggle to simultaneously achieve structured, stage-aware reasoning and seamless empathy-expertise alignment, often resulting in an artificial splicing of clinical strategies and generic reassurance. To overcome these limitations, we propose ESCRAG-R1, a unified framework that integrates retrieval-based psychological guidance into Group Relative Policy Optimization (GRPO). By incorporating retrieval into the reinforcement learning loop, ESCRAG-R1 transforms external knowledge into a robust learning signal that stimulates explicit internal reasoning prior to generation and fundamentally reshapes the model's internal policy. To provide the reliable supervision required for this optimization, we construct ESC-Preference, a high-quality dataset based on a Client--Counselor--Judge evaluation framework that delivers precise, empathy-aware reward signals. Extensive experiments demonstrate that ESCRAG-R1 significantly outperforms existing baselines by mitigating superficial splicing and realizing a natural integration of professional guidance and empathetic expression. Code and datasets are released at https://github.com/Matcha-Liu/ESCRAG-R1.
Analytical analyses show that learned rubric priorities systematically vary across dialogue stages and user emotions, demonstrating that CARE adapts what is rewarded as support needs evolve.
Peng-Yu Huang, Zhi-Yuan Han, Wen-Wen Tong et al.· 0 citations
DSPO, a reinforcement learning framework that jointly promotes subjective affective coverage and visual grounding, achieves state-of-the-art performance across multiple public benchmarks, especially on the cross-domain performance, i.e., improving +10.8\% on average cross-domain accuracy than EMO-R3.
C. Ye, Wei-Dong Chen, Bing-Yan Xu et al.· arXiv.org· 0 citations
DeepSAGE (Strategic AI Guidance Engine), a hybrid LLM--Deep Reinforcement Learning (DRL) framework for stage-aware counseling dialogue grounded in the first session of Cognitive Behavioral Therapy (CBT), suggests that combining stage-structured dialogue with learned strategy selection is a promising approach for AI cou...
Qi Zhang, Heajun An, P. Dumaru et al.· 0 citations
Procrastination negatively affects productivity and well-being, yet current large language models (LLMs) often lack the nuanced emotional understanding necessary for effective behavior-change support. This study proposes emotionally intelligent preference optimization (EIPO), a unified framework integrating emotion...
Ben Chen, Nina Dethlefs· Scientific Reports· 0 citations
RelationalDialogues is introduced, a novel, fully synthetic dataset of 12,849 multi-turn dialogues designed to explicitly train perspective-taking, demonstrating that training on highly contextualized, metadata-driven synthetic data is an effective method for advancing LLMs from displaying superficial sympathy to engag...
Neema Owji, Cameron Buckner· UF Journal of Undergraduate...· 0 citations
It is argued that emotion recognition alone is insufficient; context-sensitive strategy adaptation is required for safe and effective multimodal support.
Wei-Yi Tian, Safak Dogan, Jie Meng· Companion Publication of the...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.