This work proposes a fine-tuned multi-agent framework for detecting OCEAN personality traits, in which sub-agents are conditioned to adopt high, low, or neutral perspectives for each trait through masked language modeling (MLM) and psychometric supervision.
Abstract
Accurately assessing personality from text is challenging because traits are latent, context-dependent, and often subtly expressed across long narratives. Large language models (LLMs) offer new opportunities by processing extensive textual contexts, but pretraining of these models can induce latent"personality-like"biases, making single-model inferences inconsistent. We propose a fine-tuned multi-agent framework for detecting OCEAN personality traits, in which sub-agents are conditioned to adopt high, low, or neutral perspectives for each trait through masked language modeling (MLM) and psychometric supervision. A judge LLM aggregates and compares sub-agent outputs to generate final trait predictions, capturing multiple complementary perspectives while mitigating individual model biases. We evaluate the framework on life narrative dataset through quantitative and qualitative experiments, including baselines, ablations, and inference quality analyses. Our approach offers a scalable and interpretable method for text-based personality inference, highlighting the benefits of multi-agent reasoning grounded in psychometric supervision.
This work proposes PRISM (Persona Reasoning with Inverse SFL-based Modeling), a psycholinguistically grounded framework that reformulates persona fidelity evaluation as a structured inverse inference task, providing a more reliable framework for persona fidelity evaluation.
Meng-Fan Li, Ze-Sheng Wei, Xuan-Hua Shi et al.· 1 citation
A rigorous, large-scale analysis of gender bias in a diverse set of 20 publicly available Spanish generative LLMs, finding systematic patterns consistent with pervasive cultural stereotypes, echoing findings from earlier masked language models are uncovered.
Ismael Garrido-Muñoz, Fernando Javier Martínez Santiago, Arturo Montejo-Ráez· International Conference on...· 0 citations
Evaluating creativity in large language model (LLM) outputs remains challenging because creativity is multidimensional and human-centered. We examine how reliably LLMs evaluate short literary text in Persian, a low-resource language, across multiple evaluation strategies and prompt formulations. We find that LLM-human...
Mohammad Reza Modarres, Armin Tourajmehr, Yadollah Yaghoobzadeh et al.· 0 citations
This work introduces XstrAI, an audience-aware multi-agent framework that treats local explanations as fixed evidence and structures how it is communicated to each target reader, and evaluates XstrAI on diabetes and stroke risk prediction against 11 baselines.
F. Musicco, Danilo Danese, Giuseppe Fasano et al.· 0 citations
MindEvolve is introduced, an autonomous workflow designed to predict behavior in social interactions by generating interpretable symbolic models of cognition, and provides a roadmap for advancing LLM-based cognitive modeling toward human-expert-level theory construction.
Ying-Ying Ye, You-Le Fang, Xiao-Xue Gao et al.· bioRxiv· 0 citations
The Evidence-Grounded, Social-Weighted Persona Panel is proposed, a three-stage GenUI evaluation method in which a panel of psychologically diverse, evidence-grounded personas independently rates a screenshot, exchanges opinions under a trait-derived, semantically-gated bounded-confidence mechanism, and is aggregated v...
Zheng Wu, Yibo Luo, Pu Zhang et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.