Skip to content
Conference

The Alignment Paradox: Emotional Flattening and Social Safety Risks in Proactive AI Agents

Jul 2026 · Annual International Computer Software and Applications Conference · pp. 3238-3241 · 0 citations · 11 references
Computer Science

Abstract

Treating “safety” as synonymous with toxicity prevention made sense when AI systems were passive query responders. It makes far less sense once those systems handle mental health triage or customer grievance escalation, where reading and matching emotional register is a core functional requirement. RLHF-based alignment penalises expressive, affectladen outputs and drives models toward a neutral mean. We hypothesise that sustained alignment pressure progressively compresses a model's emotional output space, a phenomenon we term Emotional Flattening. To examine this, we use Activation Steering as a controlled proxy and track degradation in Gemma2B and Llama-3-8B across increasing steering strengths. The failure modes are architecture-dependent. Gemma-2B collapses into degenerate repetitive output; Llama-3-8B retains syntactic coherence while losing affective signal. Both outcomes erode the relational competence proactive agents depend on, pointing to what we term the Social Safety Gap in current alignment evaluation.

View source

Similar papers

#artificial intelligence Preprint Aug 2026

PsychoAgent: An Affect-Sensitive Cognitive Architecture for Conflict-Aware Memory in LLM Agents

Human-like cognition does not select past experience by topical similarity alone: affective significance and unresolved conflict also shape what becomes accessible. We present PsychoAgent, a cognitive architecture for LLM agents that separates factual and affective memory and integrates both through a conflict-aware ex...

Mohammad Amanlou, Parham Abed Azad, F. Davoodi et al. · 0 citations
Open access Aug 2026

Can Artificial Intelligence Make Us Happier? Dynamic Capability-Dependency Theory and a Two-Horizon Framework for AI-Mediated Well-Being

DCDT develops Dynamic Capability-Dependency Theory (DCDT), an integrative framework that treats AI-mediated happiness as a two-horizon process and introduces the Temporal Well-Being Reversal condition, in which initially positive AI effects become negative after capability erosion, relational substitution or dependency...

Kwan-Hong Tan · 0 citations
Review Open access Sep 2026

Emotional Dependency and Parasocial Grief Following the Alteration or Loss of Companion Artificial Intelligences: A Systematic Review

It is preliminarily concluded that the loss or modification of companion AI agents may be linked to a psychosocial impact that presents descriptive similarities to interpersonal breakups or disenfranchised grief.

Johanna Lilibeth Alcívar Ponce, Wilson Alexander Zambrano Vélez, G. Zavala et al. · 0 citations
Preprint Aug 2026

PsychJail: Exploring Psychological Jailbreaks via Multi-Turn Persuasion of LLM Policies

PsychJail is presented, a psychology-guided framework for red teaming aligned LLMs through theory-grounded, multi-turn persuasion and establishes psychological jailbreaks as a distinct red-teaming frontier for increasingly interactive LLMs.

Ze-Yu Feng, Qing-Yuan Wu, Yu-Zhe Luo et al. · 1 citation
Jul 2026

Beyond Feeling Better: Capability-Sustaining Emotional Dialogue as a Longitudinal Research Paradigm

Emotional dialogue research includes two influential strategy traditions. Empathetic dialogue prioritizes understanding a speaker's emotional experience. Emotional support conversation selects and sequences support for the seeker's current needs. Sustained use introduces a further goal. Effective support should sustain...

Ming Wang, Jiaqi Wu Young, Wenfang Wu et al. · 0 citations
Preprint Aug 2026

NTDH: Complex Reasoning for Comprehensive Affective Analysis

This work recast the affective analysis task as a complex-reasoning problem, which yields one output interface across heterogeneous label spaces and a trajectory over which a verifiable reward can be optimised; to the authors' knowledge, this is the first such treatment covering both sentiment and emotion.

Tianlei Zhu, Zhiwei Liu, Yu-Yan Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.