Skip to content
Preprint

On the optimality of antithetic randomization for cross-validation

Aug 2026 · 0 citations · 13 references
Mathematics

Abstract

In the classical normal means problem, independent train--test folds can be constructed by perturbing the data with normal randomization. Averaging over $K$ such folds yields a cross-validation estimator whose bias depends on the marginal distribution of the randomization variables, while its variance depends on their joint distribution. This raises the questions: which joint law is optimal, and how to construct the corresponding randomization scheme? We show that: (i) for smooth estimators, antithetic randomization with pairwise correlation $\rho=-1/(K-1)$ is necessary and sufficient for the reducible variance due to randomization to remain bounded as the bias vanishes; (ii) a general construction yields a class of antithetic schemes, within which the jointly normal scheme is minimax optimal; and (iii) for non-smooth estimators with finitely many jump discontinuities, antithetic randomization improves the asymptotic rate of the reducible variance, while a simple control variate restores bounded variance when the discontinuities are known.

View source

Similar papers

Preprint Aug 2026

Sharp Minimax Theory for Randomized Experiments

We study minimax-optimal designs and estimators for estimating the sample average treatment effect in finite population randomized experiments, where both design and estimator are unrestricted. For binary potential outcomes, we show this minimax risk is equivalent to the minimax risk $\rho_n^*$ of an estimation problem...

Timothy Sudijono, Edgar Dobriban, E. Tchetgen · 1 citation
Preprint Sep 2026

The Equivariance Criterion in a Linear Model for Random-$X$ Cases

The equivariance criterion was applied to the normal linear model with a fixed design matrix, yielding the minimum risk equivariant estimators of the coefficient vector and of the condensed diagonal covariance matrix under a multivariate invariant location--scale group, extended to the random-$X case, with covariates s...

Zheng-Yan Zhang, Hao-Jin Zhou · 0 citations
Preprint Aug 2026

Distribution-free testing of linear type

We introduce a distribution-free goodness-of-fit test, termed the omega-1 test, which naturally complements the Kolmogorov--Smirnov test and Cram\'{e}r--von Mises test and can be viewed as their (piecewise) linear analog. Defined as an $\mathrm{L}^{1}$-functional of the empirical process, the test statistic improves on...

Wei-Xu Xia · 0 citations
Case report Open access Aug 2026

Optimal Experimental Design and Estimation when Potential Outcomes are Bounded

I study the optimal design and analysis of randomized experiments for estimating finite-population average treatment effects when potential outcomes are known to be bounded, as with binary outcomes. Among all assignment mechanisms and a broad class of affine estimators, worst-case mean-squared error (MSE) is minimized...

Peter Hull · 0 citations
Preprint Aug 2026

A Central Limit Theorem for Regularized M-Estimators

We prove a quantitative central limit theorem for linear functionals of regularized empirical-risk minimizers in the proportional-dimensional regime \(p=O(n)\). The data columns are independent, not necessarily identically distributed, and satisfy a uniform columnwise Poincar\'e inequality. Under uniform curvature and...

Cosme Louart · 1 citation
Preprint Aug 2026

An Entropy-based Coefficient of Determination with Adjustment of Optimization Bias

Classical likelihood-ratio tests and $\Delta$AIC exacerbate the statistical significance crisis by scaling with sample size, often flagging negligible improvements as highly significant. While causal estimands like the average treatment effect (ATE) quantify practical magnitude, their reliance on the expectation operat...

Long-Xian Li · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.