Skip to content

Tensor Quantile Regression With Exponential‐Type Penalty

Jul 2026 · Statistical analysis and data mining · 0 citations · 32 references

TL;DR

A robust tensor quantile regression method, in which CANDECOMP/PARAFAC (CP) decomposition is employed for dimension reduction, and an exponential‐type penalty (ETP) is imposed at the element‐wise level to achieve sparse variable selection.

Abstract

Tensor‐valued covariates are increasingly common in multiway measurements, but traditional vector‐valued regression ignores their inherent structure and leads to fragility. In practice, such data are frequently contaminated by heavy‐tailed errors and outliers, and least square estimators lack robustness. In this paper, we propose a robust tensor quantile regression method, in which CANDECOMP/PARAFAC (CP) decomposition is employed for dimension reduction, and an exponential‐type penalty (ETP) is imposed at the element‐wise level to achieve sparse variable selection. The ETP smoothly interpolates between and , reducing bias for large coefficients while preserving computational tractability. We develop an efficient algorithm based on alternating direction method of multipliers (ADMM) framework to solve the ETP‐penalized tensor quantile regression estimator. Theoretically, we address the identifiability of the CP decomposition and establish asymptotic properties, including the estimation consistency and the oracle property. Extensive simulation studies under two representative sparse signal settings show that the proposed method substantially improves signal recovery, estimation accuracy, and predictive performance over quantile regression on vectorized covariates and existing tensor regression methods. An empirical analysis of the Beijing dataset further demonstrates superior predictive performance of the proposed method and reveals pronounced spatial and quantile heterogeneity in the effects of major air pollutants.

View source

Similar papers

Open access Aug 2026

Robust Functional Regression via FPCA, Copula-Scale Design, and Multivariate Bernstein Smoothing

We introduce a robust nonparametric regression framework for functional covariates that combines functional principal component analysis (FPCA), marginal copula-scale normalization, bounded-score M-estimation, and multivariate Bernstein smoothing. The proposed procedure reduces the infinite-dimensional functional predi...

Wahiba Bouabsa, F. Alshahrani · 0 citations
Preprint Aug 2026

Distributed Stochastic Smoothing ADMM for Penalized Quantile Regression

A distributed stochastic smoothing alternating direction method of multipliers (DSS-ADMM) for horizontally partitioned penalized quantile regression, which characterize the scope of an extension to the minimax concave penalty and the smoothly clipped absolute deviation penalty.

Rongmei Liang, Xiao-Fei Wu · 0 citations
Preprint Jul 2026

Exact Generalization Error Curves of Kernel Ridge Regression for Functional Moment Estimation

Kernel ridge regression is a standard method for functional data analysis, but its exact behavior is less understood. We study tensor-product kernel ridge regression for estimating the $r$-th moment function of a random function based on noisy discrete observations. The formulation includes mean estimation, covariance...

Yi Ding, Yicheng Li · 0 citations
Preprint Aug 2026

Generalization Error Estimation for Primal--Dual Algorithms in Non-Smooth Regression

A general recursive framework that includes the Chambolle--Pock algorithm and related primal--dual splitting methods is developed, which proves finite-sample guarantees for both estimators and establishes a matched-Gaussian universality result beyond Gaussian designs.

Kai Tan, Pierre C. Bellec · 0 citations
Preprint Aug 2026

Regularized High-Dimensional Additive Tensor Autoregressive Model

This work proposes a regularized additive tensor autoregressive model with additive interaction of row-wise, column-wise and tube-wise temporal dependence that offers more interpretability, less computational burden due to its convex nature and estimation of the underlying low rank plus sparse pattern of its transition...

D. Ghosh, Nilanjana Chakraborty, S. Roy · 0 citations
Aug 2026

Transfer Learning for High‐Dimensional Huber Approximate Quantile Regression via Elastic Net

This paper proposes a novel transfer learning framework for high‐dimensional quantile regression, addressing the non‐differentiability of quantile loss via a Huber approximation and leveraging elastic net regularization to handle sparse inference. By replacing the piecewise linear quantile check function with a smoot...

Zixin Lv, Yicheng Liu, Kang Meng et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.