Skip to content
Preprint

Multicollinearity-agnostic feature screening for non-Euclidean responses: a factor adjusted approach

Sep 2026 · 0 citations · 41 references
Mathematics

Abstract

In high-dimensional settings, multicollinearity is a pervasive issue that can substantially impair the performance of feature screening methods based on marginal Fr\'echet regression. Feature screening for non-Euclidean responses becomes unreliable when ultrahigh-dimensional predictors suffer from multicollinearity, because feature-specific signals may be masked by shared latent factors. To mitigate this effect, we propose a Factor adjusted Fr\'echet sure independence screening procedure. The method first recovers latent common factors from the predictors and then evaluates each feature by the incremental Fr\'echet coefficient of determination contributed by its idiosyncratic component beyond the common factors. Under regularity conditions, we establish uniform approximation rates for the feasible screening utilities and prove the sure screening and sure ranking properties. Extensive numerical experiments provide compelling empirical support for the validity and effectiveness of our approach, particularly in scenarios with highly correlated covariates. We further illustrate the practical performance of our method through two representative non-Euclidean datasets: the ADNI dataset and the mortality dataset, both with distribution-valued responses.

View source

Similar papers

Preprint Sep 2026

Design-Assisted Regression

A general design-assisted regression framework in which the estimating criterion depends on both the conditional model for $Y \mid \bfX$ and structured features of the covariate distribution, which improves estimation while preserving first-order prediction performance.

S. Ye, Guan-Bo Wang, Cong Zhang et al. · 0 citations
Open access 2026

Variable Selection under Multicollinearity and Heavy-Tailed Errors: A Systematic Assessment of Classical and Penalized Methods

Variable selection in high-dimensional regression becomes particularly challenging when multicollinearity and heavy-tailed errors occur simultaneously. This study systematically evaluates the performance boundaries of classical, shrinkage, sparse, and robust regression methods under these conditions. A Monte Carlo simu...

B. Ofuru, Ijomah M. A., Nwakuya M. T. · 0 citations
Open access Nov 2026

An Adaptive Generalized M-Ridge Estimator with Bounded Influence for Contaminated Multicollinear Data

Linear regression estimation can be adversely affected by multicollinearity and outliers in both the response and predictor variables. Ridge regression addresses multicollinearity but remains sensitive to outliers, whereas robust M-estimation reduces the influence of response outliers without directly addressing multic...

Muhammad Junaid, I. S. Dar, Hasnain Iftikhar et al. · 0 citations
Oct 2026

Testing matrix factor structure via generalized likelihood ratio

In this paper, we introduce a generalized likelihood ratio test for assessing whether the factor loading matrix in high-dimensional data exhibits a Kronecker structure, thereby offering a rigorous tool for validating two-way matrix factor models. A central challenge in likelihood-based inference for factor models ari...

Xin-Bing Kong, Li-Wen Zhang, Tong Zhang · 0 citations
Open access 2026

Iterative Spectral Stabilization for Non-Uniform Multicollinearity in Integrated Datasets

Large-scale integrated datasets often exhibit non-uniform multicollinearity, where dissimilar correlation structures across batches make the merged feature set unstable, creating a critical bottleneck for stable regression analysis. While conventional methods such as Principal Component Analysis (PCA) and Ridge regress...

Abraham George, Mir Wajahat Hussain · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.