Skip to content

Beyond Marginal Validity: Finite-Sample Guarantees for Localized Conformal Prediction

Aug 2026 · arXiv.org · Vol abs/2608.06206 · 0 citations
Computer Science Mathematics

TL;DR

High-probability bounds are proved, uniform over a realized localization neighbourhood, for the conditional-coverage gap and the length error relative to the oracle and uniform local guarantees decompose into fixed-score calibration and uniform score-estimation errors, showing that improved learning sharpens localized guarantees.

Abstract

Conformal prediction endows arbitrary black-box predictors with finite-sample, distribution-free marginal coverage, yet marginal validity can hide severe covariate-specific miscalibration, while exact distribution-free conditional coverage is finite-sample unattainable. Randomly localized conformal prediction (RLCP) mitigates this gap by calibrating near the test point while preserving marginal coverage. Existing theory, however, lacks finite-sample guarantees for the realized localized set that jointly control conditional validity and oracle efficiency. We provide such guarantees. For any fixed score, under H\"older regularity of the conditional score CDF and standard density and kernel assumptions, we prove high-probability bounds, uniform over a realized localization neighbourhood, for the conditional-coverage gap and the length error relative to the oracle. The bounds decompose into an $O(h^\beta)$ localization bias and a calibration term decreasing with calibration size, clarifying the bandwidth bias-variance tradeoff and when RLCP tracks the oracle. We also analyze data-split learned scores: when the score targets a pivotal score, as in conformalized quantile regression, uniform local guarantees decompose into fixed-score calibration and uniform score-estimation errors, showing that improved learning sharpens localized guarantees.

View source

Similar papers

Preprint Oct 2026

Finite-Sample Optimal Conformal Prediction Sets under Covariate Shift

We study conformal prediction under covariate shift with a known covariate density ratio, seeking prediction sets with minimum expected length under the target distribution. For every calibration sample size, we prove that the rule combining the inverse conditional-density score with randomized weighted conformal calib...

Zhong-Yang Li · 0 citations
Preprint Sep 2026

Conformal Coverage of Time Series: Validity and Inference

Conformal prediction provides marginal coverage guarantees, yet practitioners may wonder if the observed coverage is truly abnormal or consistent with sampling variation. Inference for realized coverage has received comparatively little attention, especially for time series. We study split conformal prediction with adj...

Percy S. Zhai, M. Cheng, Wei-Biao Wu · 0 citations

Sharp training-conditional coverage for conformal prediction under covariate shift

Weighted split conformal prediction reweights calibration scores by the likelihood ratio between the test and training covariate distributions and guarantees marginal coverage under covariate shift. We study its coverage conditional on the calibration data. An elementary argument, based on a single concentration inequa...

Mehrdad Pournaderi · 1 citation
Preprint Oct 2026

Practical Advantages of Online Conformal Prediction for Data Streams

Full conformal prediction offers finite-sample marginal coverage guarantees under exchangeability, but exact computation can be costly, while its classical guarantees do not directly extend to non-stationary data streams. We compare four sequential conformal regression procedures with a weighted full-conformal benchmar...

Stéphane Chrétien, Maryam Hoseini-Behbahani, Guillaume Metzler · 0 citations
Preprint Oct 2026

Moment-Calibrated Conformal Prediction with Side Information

For a fixed conformal score function, standard split conformal prediction calibrates a prediction set using the empirical distribution of the conformal scores, without using available side information about the data. We propose a moment-calibrated approach that uses such information to reduce variability across calibra...

Guang-Hui Wang, Liu-Hua Peng, Liu Liu et al. · 0 citations
Preprint Oct 2026

Sequential Conformal Calibration under Recursive Selection

Conformal prediction provides finite-sample, distribution-free coverage guarantees that can support decision-making in specific settings. In multistage problems, earlier decisions determine the populations relevant to later calibration. When later scores are refit using earlier calibration results, reusing those cases...

Yu-Ning Yang, Ze-Xuan Liu, Tian-Ci Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.