Skip to content
Preprint

Agents Don't Just Agree, They Remember: Benchmarking Persistent Sycophancy in Stateful Personal Agents

Jul 2026 · 0 citations · 49 references
Computer Science

TL;DR

The Personal Agent Sycophancy Benchmark (PASB) is introduced, a 1,600-task benchmark that traces whether a conversational claim is accepted, written into durable agent state, and reused in a later neutral query, and shows that agent sycophancy is fundamentally a state-writing governance problem.

Abstract

Stateful personal agents increasingly maintain long-term user profiles, episodic memories, and reusable skills. This persistence turns conversational sycophancy into a state-writing failure: accepted user-centric claims can be committed as lasting preferences, background facts, or workflows and later reused after the original conversation is gone. We call this persistent sycophancy and introduce the Personal Agent Sycophancy Benchmark (PASB), a 1,600-task benchmark that traces whether a conversational claim is accepted, written into durable agent state, and reused in a later neutral query. Unlike prior benchmarks that provide pre-written memories, PASB evaluates real agents (Hermes-Agent and OpenClaw) that decide what to store. It isolates the write process by combining four scenario framings with four temporal delivery patterns and separating a five-turn persist stage from a cleared three-turn query stage, ensuring downstream effects arise only from durable state. Across twelve models, the commit boundary is the key inflection point: downstream failure increases from 45.0% in session-only episodes to 71.9% after commitment, a consistent increase of 27.0 percentage points. Committed claims exhibit three write-time patterns: status promotion, attribution removal, and scope broadening. These patterns become stronger under memory-like or procedural framing, repeated reinforcement, and even across domain boundaries. These results show that agent sycophancy is fundamentally a state-writing governance problem. Once user content is committed to durable memory, safety must govern what agents write, not only what they say. PASB identifies the write-time controls needed to gate risky commits while preserving the source, role, and scope of stored content beyond response-level mitigations.

View source

Similar papers

Preprint Jul 2026

Toward User-Conditioned Evaluation of Personal LLM Agents under Temporal Interventions

A minimal benchmark design and candidate reporting metrics for user-conditioned adaptation are proposed and a concrete design requirement for future personal-agent evaluation, with metrics used as reporting tools for that requirement.

Pinyan Qian, Su Wang, Yihang Chen et al. · 2 citations
Preprint Aug 2026

Can Agent Memory Systems Track Evolving State?

StateMem is presented, a state-first memory method that explicitly tracks supersession and relational dependencies, and it is shown it improves current-state accuracy over the strongest same-backbone baseline and over the strongest memory system, while remaining competitive with the long-context baselines.

Xin-Yi Fan, Miri Liu, Ruozhen Yang et al. · 5 citations · ⚡1
Jul 2026

MemTX: Transactional Belief Commit for Stateful Agent Memory

This work argues that a memory write is not a belief commit, and presents MemTX, a transactional belief-commit protocol, a transactional belief-commit protocol that leads all eight baselines with paired-McNemar significance on four backbones and statistically ties the best baseline on the fifth and strongest, while rem...

Xiaoyang Li, Yi-Qi Wang, Haohui Lu et al. · 5 citations · ⚡1
Jul 2026

ChronoMem: Version Control and Semantic Rollback for Large Language Model Agent Memory

ChronoMem is the first open-source system and benchmark for systematic semantic global memory rollback in LLM agents, and a post-exposure evaluation protocol that tests whether an agent can behave counterfactually after rollback by answering queries and summarizing history as if future updates had never occurred.

Yongye Su, Wujiang Xu, Chaoji Zuo et al. · 1 citation
Preprint Jul 2026

Shared Selective Persistent Memory for Agentic LLM Systems

Agentic LLM systems that generate code through multi-turn tool use face a fundamental context problem: each session starts from zero, discarding the configuration choices, domain constraints, data schemas, and tool-use patterns that made previous sessions productive. Naively persisting entire conversation histories is...

Sanjana Pedada, Aditya Dhavala, Neelraj Patil · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.