Skip to content

Epistemic Sybil Resistance: Multiplying AI Agents Without Multiplying Evidence

Sep 2026 · 2 citations · 29 references
Computer Science

TL;DR

Collective inference should track evidential ancestry and dependence, not agent or report multiplicity or similarity, not agent or report multiplicity or similarity.

Abstract

Multi-agent AI systems improve inference by spawning agents and synthesizing reports. But another agent is not another observation: apparently independent reports may descend from the same evidence, and genuinely independent evidence can produce nearly identical reports. We formalize this as an epistemic Sybil problem. A report Z is an epistemic Sybil extension relative to reports R when I(Theta; Z | R) = 0. No report-only aggregator can generally distinguish replication from independent corroboration: identical reports can warrant different posteriors under unobserved ancestry. A Gaussian shared-root model shows common ancestry does not imply complete redundancy. Repeated extraction adds information toward a source-level ceiling, and correlated extraction errors, which a shared base model can induce among independent agents, lower that ceiling further. We test these predictions with more than 20,000 controlled LLM-agent report and extraction calls on synthetic evidentiary documents. Holding one evidence root fixed while report multiplicity rises from 1 to 32 collapses naive posterior coverage from 0.940 to 0.263. Holding report count fixed while evidence-root multiplicity rises from 1 to 16 closes the gap, and the aggregators are statistically indistinguishable at k = 16. The agent's replicate extraction errors are correlated (gamma_cal = 0.719, estimated out of sample), and a correlated-extraction aggregator restores calibration accordingly. A controlled manipulation isolates representation similarity from evidential ancestry. It changes a report-space deduplication mechanism's mean inferred cluster count by 1.425 (95% CI [1.363, 1.485]), whereas a fourfold change in true ancestry changes it by only 0.040 ([-0.045, 0.120]). Collective inference should therefore track evidential ancestry and dependence, not agent or report multiplicity or similarity.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Bayesian Intelligence from the Outside

A theory of Bayesian intelligence for agents such as language models is developed and the difficulty of aggregating coarse reports from intelligent agents is shown: unless the agent reports a belief about the complete state of the world, the optimal aggregation can assign arbitrary weights to states that have not been...

Alex Smolin, Bryan Wilder · 0 citations
#artificial intelligence Preprint Sep 2026

A Benchmark and Diagnostic Study of Epistemic Admission in Shared Agent Memory

The Correlated Promotion Benchmark (CPB), which evaluates whether candidate claims should be admitted to shared memory, shows that policies which deduplicate sources reject many true claims alongside false ones, whereas policies preserving answer coverage admit nearly as many false claims as unrestricted sharing.

Xiao-Yang Li, Yi-Qi Wang, Chen-Cheng Zhu et al. · 1 citation
#artificial intelligence Conference Open access Sep 2026

Self-Reports Are Not Verification

An environment-grounded audit is introduced in which every intermediate proposal receives an exact outcome in an evolutionary Contexto search whose feedback function assigns every valid guess an exact rank without human annotation.

En-Rong Pan, Ryan Zhou, Ting Hu · 0 citations
#natural language process... Preprint Sep 2026

XYEval: Agents say yes to bad advice

Effective communication between users and AI agents is essential for human-AI collaboration. The XY problem is a well-known communication pitfall where a person asks about their attempted solution rather than their actual problem. We extend prior sycophancy evaluation to the XY problem in agentic settings, evaluating w...

Zheng-Xuan Wu, Yuxuan Li, O. Tafjord et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Provenance-Aware Belief Updating in Human-AI Feedback Loops

In repeated human-AI interaction, a single observation can be quoted, summarized, and returned to a model as multiple reports, making repetition look like independent corroboration. We study whether language models can use supplied report lineage to update according to evidence provenance rather than report count. We i...

Tian-Yi Huang, Eric Liu, Jay Chong et al. · 0 citations
Preprint Sep 2026

AI-Research Agents in the Wild. From GitHub and arXiv to Regularities and Gaps

AI-research agents, or autoresearch systems, combine language models with tools, search, evaluation, and iterative modification of research artifacts. Their public software ecology is hard to compare because repositories, papers, benchmarks, libraries, and companion artifacts are often counted as one population. We con...

Aleksey Komissarov, A. Ustyuzhanin · 0 citations

Related blog posts

Hugging Face Blog Nov 10, 2026

Decision Models in Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.