Skip to content

Political Ideology Shifts in Large Language Models

Aug 2025 · Information Processing & Management · Vol abs/2508.16013 · 5 citations · 87 references
Computer Science

Abstract

Large language models (LLMs) are increasingly deployed in politically sensitive contexts, raising concerns about their susceptibility to ideological biases. In this work, we examine how synthetic persona conditioning shapes ideological expression across seven open-weight instruction-tuned models (7B-72B parameters) using the Political Compass Test (62 statements) as a standardized behavioral probe. Across three studies involving 200,000 synthetic personas and more than 260 million model responses, we analyze implicit and explicit malleability, as well as theme-associated variations. We find that: (i) larger models exhibit broader implicit ideological coverage, increasing from 14-35% for 7-8B models to up to 49% for 70B+ models; (ii) explicit ideological priming induces large and statistically significant shifts, with right-authoritarian cues moving all models in the intended direction and producing larger effects in most model-axis comparisons; (iii) left-libertarian priming produces more heterogeneous responses, including counter-directional economic shifts in three of four 7-8B models, while all 70B+ models move in the intended direction; and (iv) theme-associated semantic content in persona descriptions is linked to systematic and interpretable directional shifts in ideological space. While our results identify an upstream mechanism through which persona conditioning can alter model responses under a standardized ideological probe, we do not test whether such shifts affect users beliefs, decisions, or political behavior. Our findings are best understood as evidence of ideological malleability at the generation layer, highlighting the need to account for interactional factors when evaluating political neutrality, fairness, and safety in English-prompted, persona-conditioned language models.

Read PDF

Similar papers

Framing the Narrative: Ideological Mimicry in Large Language Models

Large language models (LLMs) are increasingly used to answer questions about politically contentious issues, yet evaluations typically treat a model's stance as a relatively stable property. Real users, however, communicate political signals through their terminology, assumptions, and personal context. We investigate w...

Olivia Macmillan-Scott, Michael B. Jacobs, Nils W. Metternich et al. · 0 citations

Gender bias across LLMs is common and highly heterogeneous

Bias auditing should be treated as an ongoing, multi-vendor process, rather than a one-time assessment, because gender-related biases are common in LLMs, but their direction and magnitude are highly heterogeneous, to the point that some models behave in diametrically opposite ways to others.

E. Bolzoni, Valerio Capraro · 1 citation
#artificial intelligence Preprint Aug 2026

How Identity and Opinion Shape Political Sycophancy in LLMs

A framework that disentangles two distinct triggers of political sycophancy: opinion (aligning with explicit narratives) and identity (stereotyping based on demographic labels) is introduced, highlighting how personalization may amplify identity- or opinion-conditioned shifts in the model's behaviors.

Li-Ni Fu, Chang-Chih Meng, Chien-Hua Chen et al. · 0 citations
#natural language process... Preprint Sep 2026

Navigating the digital spectrum: Assessing political bias, stability, and downstream fairness in Large Language Models

A robust Political Compass Test evaluation framework is introduced that samples 300 configurations across an eight-dimensional perturbation space varying language, framing, instructions, answer format, option order, and persona wording, and results show most models lean Libertarian-Left on average and larger models sho...

Luka Debevc, Nishan Chatterjee, Antoine Doucet et al. · 0 citations
2026

From Body to Mind: Analyzing Gender Representation in Spanish Generative Language Models

A rigorous, large-scale analysis of gender bias in a diverse set of 20 publicly available Spanish generative LLMs, finding systematic patterns consistent with pervasive cultural stereotypes, echoing findings from earlier masked language models are uncovered.

Ismael Garrido-Muñoz, Fernando Javier Martínez Santiago, Arturo Montejo-Ráez · 0 citations
#artificial intelligence Preprint Sep 2026

We're Cooked! - Probing LLM Political Alignment Via Conflict-Framed Recipe Translation

Large language models (LLMs) are increasingly deployed for translation tasks, yet their implicit political positioning in such contexts remains understudied. We ask whether a single politically charged framing term, such as aggressor, enemy, neighbour, or coloniser is sufficient to trigger implicit political alignment...

Svetlana Gorovaia, A. Henestrosa, Ivan P. Yamshchikov · 0 citations

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.