Skip to content
Preprint

Statistics in the Age of AI

Aug 2026 · 0 citations · 75 references
Mathematics

TL;DR

This work formalizes the logical conditions under which data support scientific claims or consequential decisions through statistical warrant, which connects data to a claim through the target, observation regime, assumptions, procedure, uncertainty assessment, validation criterion, loss structure, governance and accountability.

Abstract

Artificial intelligence (AI) can automate programming, model fitting, visualization, simulation, literature synthesis, and increasingly sophisticated methodological tasks, but it cannot remove the logical conditions under which data support scientific claims or consequential decisions. We formalize these conditions through statistical warrant, which connects data to a claim through the target, observation regime, assumptions, procedure, uncertainty assessment, validation criterion, loss structure, governance and accountability. No algorithm can consistently recover a target that is not identified by the observation regime without additional information or assumptions. From this principle, we organize the argument around five statements. Questions and targets are integral to statistical methods. Data acquire evidential meaning only through design, provenance, and assumptions. Description, prediction, causal inference, and decision are mathematically distinct tasks. Analytical abundance requires accounting for how analyses are selected, uncertainty across the analytical system, and deployment validation. The statistician's fundamental role is therefore to construct, criticize, and safeguard statistical warrant, including by developing new methodology when existing theory is inadequate. This role requires statistical reasoning and attributable human and institutional responsibility.

View source

Similar papers

Sep 2026

Governing data risks in the age of AI

This paper proposes a practical, audit-ready approach to governing data risks in the AI era, and introduces the concept of critical data elements (CDEs): data elements whose inaccuracy, unavailability, or misuse can produce material regulatory, financial, or customer-facing impact.

Xin-Fa Tu · 0 citations
Case report Open access Aug 2026

The Measurement Revolution? Credible Measurement and Inference in the Age of AI

It is argued that credible inference with AI-generated variables requires appropriately designed validation: anchoring measurement to explicit criteria, rather than informal claims that a proxy is reasonable, and how validation samples support valid inference even when AI predictions are arbitrarily biased.

Melissa Dell, Ashesh Rambachan · 3 citations
Review Open access Oct 2026

Engineering Data Analysis Beyond Statistics vs. Machine Learning: A Review of Explanation, Prediction, Hybrid Modeling, and Responsible Decision Support

This structured narrative review explores how engineers select and evaluate traditional statistical, machine learning, mechanistic, and hybrid methods for explanation, prediction, and responsible decision support. We identified representative literature available through 2025 via iterative searches of Web of Science, S...

Hsuan-Yu Chen, Chia-Chung Chen · 0 citations
Review Sep 2026

Data, data science, and official statistics

The emergence of data science, big data, and new digital sources has profoundly changed the environment in which official statistics are produced. However, many of the challenges associated with these developments are not new: they concern the definition of statistical units, the construction and validation of data, th...

Yves Tillé · 0 citations
Sep 2026

Responsibility to the Problem: An Explicit Standard for the Expert–AI System

Discussions of artificial intelligence in science ask who is responsible when AI produces an incorrect result. This question is vague unless it identifies the object of responsibility, evidence, decisions, and cognitive process. Public criticism often isolates an erroneous output while omitting the question, informatio...

Laboratory of Information Systems · 0 citations
#machine learning Preprint Sep 2026

Can Tabular Foundation Models Amortize Statistical Inference?

TabCon is developed, an amortized inference system built on a tabular foundation model that produces confidence intervals for new datasets through a simple forward pass, and offers considerably greater computational efficiency than the classical bootstrap procedure.

Kai Ye, Shi-Jin Gong, Hong-Yi Zhou et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.