Skip to content
Preprint

A Multiverse of Good and Bad Controls: Candidate Causal Graphs for Interpreting Model Robustness Analysis

Sep 2026 · 0 citations
Mathematics Economics

Abstract

Model robustness analysis estimates an effect across a multiverse of specifications that pools control sets identifying the declared estimand with sets that condition on mediators or colliders. We propose stating rival assumptions about contested controls as a small set of candidate causal graphs, enumerating the adjustment sets each graph licenses, and reporting robustness metrics conditional on each graph. A finite-mixture identity splits the licensed multiverse's dispersion into within-graph and between-graph components; the between-graph share is a conditional descriptive summary whose reading depends on the candidate set, the weights, and a common estimand. Simulations examine misleading pooled robustness assessments and the limits of the decomposition. Applications to hurricane fatalities, job training, and union wages show fragility that survives every graph, instability produced by unlicensed specifications, and a fragility verdict concealing a significant premium in each adjustment-identified candidate world. An R package implements the workflow.

View source

Similar papers

Review Nov 2026

When Listwise Deletion Works: Causal Diagrams and Complete-Case Regression

Listwise deletion (LWD) appears more common than imputation: at least 50% of the observational causal studies we review in leading journals state or imply it, while 7% describe an imputation model. We develop a framework for when complete-case regression consistently estimates the population average treatment effect (A...

Wen-Xin Lin, Shi-Ya Liu · 0 citations
Preprint Nov 2026

A General Approach for Assessing Sensitivity to Violations of Causal Assumptions

Although causal sensitivity analyses are widely used to assess the robustness of conclusions, a key limitation is that existing methods are typically developed for specific designs. This paper develops a general sensitivity analysis framework that applies to a wide range of discrete causal models and estimands by deriv...

G. Duarte · 0 citations
Preprint Oct 2026

confoundvis for Visualizing and Reporting Sensitivity to Unmeasured Confounding in R

Sensitivity analysis asks how strong unmeasured confounding would have to be before an observational conclusion changes. Several R packages already calculate established sensitivity quantities, but their outputs use different parameters, objects, and plotting conventions. In this article, we describe confoundvis 0.3.0,...

Subir Hait · 0 citations

Forecast-Necessary Causal Discovery for Nonlinear Political Panel Data: Feedback, Functional Form, and the Dynamics of Democratization

A non-significant coefficient in a dynamic panel model need not imply the absence of a relationship. It may instead reflect heterogeneous effects averaged toward zero, reciprocal dynamics overlooked by a recursive specification, or relationships masked by the omission of correlated covariates. Standard linear estimator...

M. Coppedge, Dmitry G. Zaytsev, V. Kuskova · 0 citations
Preprint Nov 2026

Interpretable confidence regions for causal discovery

Most work in causal discovery focuses on point estimation of the underlying causal graph, while uncertainty in the learned structure has received substantially less attention. We develop confidence regions for the completed partially directed acyclic graph (CPDAG) identified from observational data. Our approach builds...

Jian Kang, Arnav Mazumder, G. Lembo et al. · 0 citations
Preprint Oct 2026

Interpretable subgroup identification across survival and generalized-linear outcomes

A subgroup analysis searching a trial's covariates or many prespecified subgroups often singles out a subgroup for its extremity, interpreted as if prespecified. Selection inflates the estimate; for a given selection rule, a correction removes the inflation. Two questions belong to the rule: which candidate to return,...

L. León, K. Anderson · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.