Skip to content

ProfileFoundry: A Synthetic Person-Object Substrate for Privacy, Memory, and Tool-Use Evaluation in LLM Agent

Jun 2026 · arXiv.org · Vol abs/2606.26403 · 0 citations · 34 references
Computer Science

TL;DR

ProfileFoundry is a deterministic generator and fixed reference release of 100,000 adult synthetic Person Objects, a responsible synthetic source layer for constructing downstream foundation-model evaluations involving memory, privacy, document understanding, record linkage, and agent state while keeping the synthetic person behind each artifact inspectable.

Abstract

Foundation-model research increasingly needs data about people: user state, personal histories, relationships, contact-like fields, documents, and longitudinal updates. Real user data is difficult to share, perturb, audit, or redistribute responsibly, while independently generated fake fields rarely preserve the cross-field and temporal consistency needed for controlled evaluation. We present ProfileFoundry, a deterministic generator and fixed reference release of 100,000 adult synthetic Person Objects across eight locales. Each object combines a typed current snapshot, household, family, and employer links, snapshot-aligned events, normalized relational views, and generation provenance. The release contains 709,228 events, 40,338 households, 52,491 employers, and 518,564 directed relationship edges. We report evidence in separate categories: selected population-marginal comparisons, per-object invariant checks, release-wide referential and temporal closure, and coincidence/provenance screens. A pilot case study, MatchDesk, uses certified coincidences, typed events, and history truncation to evaluate whether models distinguish corroborated identity evidence from underdetermined matches. ProfileFoundry is not a population-fidelity model, a rendered-text corpus, or a formal privacy mechanism. Instead, it is a responsible synthetic source layer for constructing downstream foundation-model evaluations involving memory, privacy, document understanding, record linkage, and agent state while keeping the synthetic person behind each artifact inspectable.

View source

Similar papers

#artificial intelligence Review Sep 2026

ASLEval: Measuring Privacy Exposure Displacement in LLM Agent Sessions

Privacy exposure displacement, the mismatch between a local evaluation proxy and target-grounded session exposure, and ASLEval, an authorization-aware framework that pre-registers a hidden target set, measures all declared visible exits, and reserves internal traces for diagnosis are introduced.

Guo-Xin Wu, Hui-Zhen Huang, Guo-Xiong Long et al. · 0 citations
Preprint Aug 2026

Secret MCP: Evidence-Bounded and Context-Isolated Design Specification Generation from Web Screenshots

Screenshot-to-code systems optimize for rendered implementations, but screenshots omit document structure, interaction logic, responsive rules, and provenance needed to distinguish observation from guesswork. Multi-reference prompts also risk contaminating one reference with evidence or inferences from another. We pres...

Yeong-Woong Jo · 0 citations
#artificial intelligence Preprint Sep 2026

PAPC: Platform Mediation for Privacy-Propagation Externalities in AI-Mediated Workflows

This work presents PAPC, a platform-mediated mechanism that intercepts information-moving events before they update shared state or external channels and positions event-level mediation as a platform-governance primitive for agent-mediated online work.

Tao Huang, Guo-Xin Wu, Chen Hou et al. · 0 citations
Preprint Aug 2026

MNC: Scope-Bound Semantic Declassification for Private LLM-Agent Communication

Minimum-Necessary Communication is introduced, a typed semantic-declassification protocol that selects a task-sufficient disclosure from an application-authored candidate family and binds it to explicit recipient, purpose, forwarding, lifetime, logging, and memory scopes.

Jingheng Xu, Longze Fan, Zeyuan Wang et al. · 0 citations
Preprint Sep 2026

The Shape of Ownership: Verifying LLM Provenance through Semantic Structures

This work introduces PROSE (Provenance through Relational Organization of Semantic Expression), replacing fixed query sets with a target semantical domain and brittle response keys with semantic structures internalized as domain-conditioned response behavior.

Zhong-Rui Sun, Jia-Hao Chen, Ou-Bo Ma et al. · 0 citations
Review Open access Sep 2026

Privacy-Preserving Structured Knowledge Extraction from Census-Style Records Using a Hierarchical Multi-Agent Open-Weight LLM Architecture

The design and implementation of a three-stage Planner–Manager–Worker pipeline using a locally deployed open-weight language model is described, which includes address-specific extraction, same-model semantic consistency review, formatting, record-preserving chunking, and an exploratory bounded retry pathway.

Adeeba Tarannum, Muzakkiruddin Ahmed Mohammed, Shames Al Mandalawi et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.