Skip to content
Preprint

A Deep Learning Model for Spatially Clustered Data via Differentiable Cluster Assignment

Aug 2026 · 0 citations · 21 references
Mathematics Computer Science

TL;DR

Simulations show that joint estimation is useful when regression surfaces change abruptly across spatial boundaries, including settings with nonlinear effects, unequal region sizes, preferential sampling, and spatially correlated errors.

Abstract

We consider nonparametric regression when the association between a response and its covariates changes across an unknown partition of a spatial domain. The proposed estimator learns the partition and the cluster-specific regression functions jointly. A neural network depending only on location determines cluster membership, while separate neural networks describe the covariate--response relationship within the clusters. An annealed softmax relaxation permits gradient-based estimation of the otherwise discrete assignments. Graph-Laplacian and occupancy penalties are used to discourage fragmented regions and degenerate solutions. We establish identifiability up to label permutation, bound partition error under a margin condition, and decompose prediction risk into regression and assignment components. The resulting rate agrees with that of an oracle estimator when the partition is estimated sufficiently accurately. Simulations show that joint estimation is useful when regression surfaces change abruptly across spatial boundaries, including settings with nonlinear effects, unequal region sizes, preferential sampling, and spatially correlated errors. Finally, a real data analysis is provided to demonstrate the validity and effectiveness of the proposed method.

View source

Similar papers

Preprint Oct 2026

Spatial Functional $k$-Nearest-Neighbour Regression under Polynomial Dependence

This paper investigates non-parametric regression estimation when the explanatory variable takes values in a separable Hilbert space and observations are sampled over an increasing regular spatial lattice. Under a rigorous field-to-field independence setup between covariates and errors, we explore the structural and as...

Stéphane Bouka · 0 citations
Preprint Aug 2026

Transfer Learning in Nonparametric Regression with Deep ReLU Networks

This paper develops a general transfer learning framework for nonparametric regression with data consisting of multiple groups. Under the assumption that groups share a common structure along with group-specific deviations in additive form, the proposed method employs a two-stage offset learning procedure: the first st...

Jun-Peng Ren, Carlos Misael Madrid Padilla, Yan-Zhen Chen et al. · 0 citations
Open access Sep 2026

Optimization-Driven Cluster-Weighted Clusterwise Linear Regression

This work introduces a novel Cluster-Weighted CLR (CW-CLR) framework based on a nonsmooth, nonconvex optimization formulation that simultaneously solves the clustering and regression tasks and proposes an improved prediction rule for Optimization-Driven CW-CLR.

Sona Taheri, A. Bagirov, Nelusha Anne Perera et al. · 0 citations
#machine learning Preprint Sep 2026

Functional Attentive Interpretable Regression

In function-on-function regression, the coefficient surface $\beta(s,t)$ may exhibit complex support structure---from localized patches to global patterns such as disconnected regions, bands, or rings---where effect similarity does not align with Euclidean proximity. Projection-based methods that rely on fixed basis ex...

Hai-Xu Wang, Tian-Yu Guan, Ji-Guo Cao · 0 citations
Preprint Sep 2026

Adaptive mixture variational inference for spike-and-slab regression

An adaptive fitting procedure for mixtures of product distributions in Gaussian regression with a point-mass spike-and-slab prior that minimizes reverse Kullback-Leibler divergence directly on inclusion indicators and active coefficients, jointly refining component parameters and weights as the mixture grows.

Han-Qing Li, Ya. V. Golub, Xue-Wen Lu · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.