Skip to content
Review

Hybrid Panels: Toward Human-AI Collaboration in Survey Research

Aug 2026 · arXiv.org · Vol abs/2608.22582 · 0 citations · 20 references
Computer Science

TL;DR

The concept of a hybrid panel is introduced by providing a definition and outlining an overarching framework, spanning data collection to data validation, spanning data collection to data validation.

Abstract

Large-scale population surveys are essential for generating robust social and scientific insights, yet they face significant challenges, including declining response rates, increasing data collection costs, long delays between data collection and data provision, and the risk of nonresponse bias. Advances in artificial intelligence (AI) have opened up new opportunities for AI-supported survey infrastructures where the goal is to overcome these challenges without limiting the data quality. A promising AI-enabled survey infrastructure for which we build a first pilot is a hybrid panel. A hybrid panel is a longitudinal AI-enabled survey which allows to iteratively improve the alignment between large language models (LLMs) and the population they aim to simulate and use the errors to inform the design and implementation of the next survey wave (e.g., inform the participant recruitment, assignment of questions to participants). It incorporates both human participants and LLMs as fundamental elements of its design. In this research note, we introduce the concept of a hybrid panel by providing a definition and outlining an overarching framework, spanning data collection to data validation. We detail results from a first pilot study to illustrate (open) challenges that we identify for hybrid panels.

View source

Similar papers

Review Nov 2026

Using AI Predictions to Augment Rather Than Replace Surveys

This study tests whether AI predictions can improve the statistical efficiency of social surveys when combined with census-scale auxiliary information and finds that supervised predictors yield effective-sample-size gains of about 7-12 percent when estimating the mean, while LLM gains are smaller but positive.

Wei Lai, Yi-Fei Zhu · 0 citations
Preprint Oct 2026

OmniMechanism Design for Human-AI Collaboration with Impressionable Minds

A rigorous and theoretically grounded framework for human-AI collaboration is introduced, termed collaborative omnimechanism design, based on a novel and computationally efficient contextual bandit variant of boosting for outcome indistinguishability, which provides a principled characterization of human impressionabil...

Tian-Wei Gao, Yi-Fei Pang, Lun-Jia Hu et al. · 0 citations
Review Open access Sep 2026

Prediction-Based Adaptive Designs for Reducing Wave Nonresponse Rates and Bias in Panel Surveys

Machine learning (ML)-based nonresponse prediction in panel surveys enables selective interventions. However, the optimal use of ML predictions in Adaptive Survey Design (ASD) remains uncertain. We propose a method that integrates field experiment results on incentives, questionnaire length, and questionnaire content w...

John J. Collins, Saskia Bartholomäus, Tobias Gummer et al. · 0 citations
Oct 2026

AI-Powered Career Guidance Systems: Foundations, Opportunities, and Challenges

Career guidance has traditionally depended on human counsellors, standardized aptitude tests, and qualitative interviews to support individuals in making informed vocational decisions. However, rapid advancements in artificial intelligence—particularly in machine learning, natural language processing, and predictive an...

Francis Joseph Ibiyemi · 0 citations
Review Open access Oct 2026

Estimating the threat of AI-agent responding across online survey platforms

Recent research and advances in LLMs have led to widespread concern that AI agents could pose as human online survey-takers. However, it remains unclear how prevalent AI agents are on survey research platforms and how to effectively detect AI agents. We validated a series of AI detection tests that effectively separate...

Grace Zhang, Robert Walatka, Stephanie Y. Chen et al. · 5 citations

Prediction-Powered Smoothing and Validation for Disaggregated AI Evaluation

A Bayesian model fit to each domain's prediction-powered estimate, with an extension that borrows strength across a reporting taxonomy, and a new, approximately unbiased design-based cross-validation score for choosing among direct and smoothed estimators for estimation and validation are derived.

Sho Kawano, Z. Li, Paul A. Parker · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.