Skip to content

Generalized Deep Regression for Repeated Measurements

Sep 2026 · arXiv.org · Vol abs/2609.25605 · 0 citations
Computer Science Mathematics

TL;DR

This paper studies the estimation of a marginal regression function from independent units with repeated binary, count, or continuous responses using ReLU deep neural networks, and derives an oracle inequality for unequal cluster sizes and a rate for compositionally smooth functions.

Abstract

In this paper, we study the estimation of a marginal regression function from independent units with repeated binary, count, or continuous responses using ReLU deep neural networks. In the model, we assume that the dependence is generated by an unobserved random mean function within each unit. We then fit a neural network with a convex generalized regression loss. We show an oracle inequality by separating conditional measurement variation from between-unit variation. In addition, we prove that with $n$ units and $m$ measurements per unit, ReLU networks can attain an integrated mean squared error of order $n^{-1}+(nm)^{-2\beta/(2\beta+d)}$, up to logarithmic factors, over $\beta$-H\"older classes. We also derive a weighted oracle inequality for unequal cluster sizes and a rate for compositionally smooth functions. For pointwise ensemble inference, we give a projection central limit theorem and prove infinitesimal jackknife consistency under an explicit asymptotic linearity condition. Simulations and real data examples are provided to support our theoretical findings and practical implications.

View source

Similar papers

On Basis Function Selection for Sparse Gaussian Process Regression

The no-data criterion is a safe default, matching or improving on truncation for HSGP, VFF and VISH, with substantial gains for VISH and improvements over a recently developed selection heuristic for that basis family.

Marnix Van Soom, I. De Boi · 0 citations
Preprint Aug 2026

Learning of deep neural network regression estimates using gradient descent with pruning

Estimation of a regression function from independent and identically distributed data is considered. The $L_2$ error with integration with respect to the design variable is used as the error criterion. An initially randomly pruned fully connected deep neural network with logistic squasher as activation function is fitt...

M. Kohler, V. M. Römer, Adam Krzyżak · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.