A coupled perturbation analysis for the entire PPMD procedure identifies how the principal errors interact and which components limit the accuracy of the nonlinear reduced order model.
Abstract
This paper presents a convergence analysis for a newly developed nonlinear model reduction method: parametric probabilistic manifold decomposition (PPMD)~\cite{guo2026parametric}. In addition, existing analyzes of nonlinear reduced order models typically treat subspace reduction, manifold representation, regression, and nonlinear reconstruction as separate components and often remain at the level of discrete state vectors. To the best of our knowledge, no theory tracks the complete error propagation in a data-dependent model whose basis, residual geometry, spectral coordinates, parameter maps, and lifting operator are all learned from the same numerical solution data. We develop a coupled perturbation analysis for the entire PPMD procedure. A trajectory geometry induced by the spatial discretization and temporal quadrature connects discrete trajectory vectors isometrically with the corresponding PDE norm. Population spectral objects are introduced to align the empirical residual coordinates and derive a uniform coordinate error estimate, whose propagation through the Hilbert-valued kernel lifting estimator is then quantified. Combining these results with the full order discretization error, weighted low-rank approximation, parameter regression, and residual representation defect yields deterministic and high-probability trajectory error bounds and consistency in probability in the continuous PDE trajectory space. The theory identifies how the principal errors interact and which components limit the accuracy of the nonlinear reduced order model.
We introduce a residual-driven procedure for training nonlinear-manifold reduced-order models for parametrized linear partial differential equations that, given prescribed latent and lifting spaces, identifies the nonlinear lifting without high-fidelity solution snapshots. The approximation is represented by a low-dimensional latent coordinate together with a nonlinear lifting into a richer reduced space. Rather than fitting the lifting to snapshot data, we determine it by minimizing a computable residual-based upper bound for the state error. For affinely parametrized operators, the resulting training objective admits an efficient offline--online decomposition, and the lifting update reduces to a sequence of low-dimensional weighted least-squares problems. Numerical evaluations on an advection--diffusion problem and a plane-strain elasticity benchmark show that the proposed approach substantially improves accuracy over linear subspaces. The resulting nonlinear models achieve accuracy comparable to snapshot-driven nonlinear-manifold training while avoiding high-fidelity snapshots in the lifting-identification stage.
Francesco A. B. Silva, J. Ragusa, T. Guo et al.· arXiv.org· 0 citations
Spectral methods are among the most widely used techniques for community detection, clustering, and graph learning. Their performance, however, critically depends on the accurate estimation of the underlying spectral subspace and can deteriorate substantially in the presence of noise, outliers, or model perturbations. To address this limitation, we propose a Regularized Projection Matrix Approximation (RPMA) framework for robust estimation of rank-$K$ projection matrices. RPMA extends classical spectral projection by incorporating a regularization term, producing projection estimates that are more robust, sparse, and interpretable. We formulate the proposed model as an optimization problem on the manifold of rank-$K$ projection matrices and exploit its geometric equivalence to the Grassmann manifold. Based on this manifold characterization, we derive the first- and second-order optimality conditions, establish the local stability of the regularized leading eigenspace, and characterize the stability of the critical-point landscape under sufficiently small regularization. To efficiently solve the resulting nonconvex optimization problem, we develop a Riemannian gradient projection algorithm with backtracking line search, together with a more efficient Cayley--Sherman--Morrison--Woodbury (Cayley--SMW) gradient method that avoids repeated eigendecompositions. Extensive experiments on both synthetic and real-world datasets demonstrate that RPMA substantially improves the recovery accuracy of projection matrices and consistently outperforms conventional spectral projection methods for community detection and clustering under noisy environments.
We introduce an intrinsic spectral sparsity model for nonparametric density estimation on compact connected Riemannian manifolds. Instead of penalizing coefficients in an arbitrarily chosen Laplace--Beltrami eigenbasis, we group each complete eigenspace and measure the Hilbert norm of its spectral component. The resulting block-variation space is basis independent and isometry invariant. We establish its structural, atomic, and nonlinear approximation properties and clarify its relation to Sobolev, Besov, and coefficientwise spectral $\ell^1$ classes. We then construct a coordinate-free block-shrinkage estimator and prove a nonasymptotic signal-dependent $L^2$-oracle inequality that adapts to the unknown set of detectable eigenspaces. Under polynomial spectral growth, the risk theory separates the number of spectral blocks from their multiplicities and exhibits two regimes: one driven by a single high-dimensional eigenspace and the other by cumulative spectral complexity. Under matching spectral-growth and nondegeneracy assumptions, corresponding minimax lower bounds show that this multiplicity dependence is intrinsic, with sharp consequences for spheres and the rotation group $SO(3)$. Finally, we develop a positive, normalized, block-penalized exponential spectral sieve for log-densities and derive likelihood oracle inequalities together with expected Kullback--Leibler, Hellinger, and $L^2$ risk bounds. The resulting framework provides a geometry-respecting theory of sparse density estimation that remains invariant under changes of eigenbasis.
This paper proposes gappy probabilistic manifold decomposition (Gappy PMD), a nonlinear method for reconstructing high-dimensional fields from extremely sparse measurements. Gappy PMD reconstructs the field on the nonlinear manifold learned by probabilistic manifold decomposition (PMD). We further propose a differentiable point selection method for reduced-order model (ROM)-based field reconstruction (DPS). Using differentiable meshless interpolation within the ROM-based reconstruction framework, DPS makes the full-field reconstruction error differentiable with respect to the sampling locations and directly optimizes these locations. In addition, a theoretical error analysis for Gappy PMD is also given. It splits the squared reconstruction error into two orthogonal parts: one normal to the reconstruction manifold and the other induced by sparse sampling and observation noise. Under a stability condition on the sampling operator, this error vanishes with the PMD approximation error and the noise. The Gappy PMD is evaluated on three numerical test cases: flow past a cylinder, lid-driven cavity flow, and backward-facing step flow. For the same reduced dimension and sampling points, Gappy PMD attains mean relative $L^2$ errors one to two orders of magnitude below Gappy POD. Optimizing the sampling points with DPS further improves reconstruction accuracy and robustness.
Qi-Han Feng, Jia-Ming Guo, Jiao Meng et al.· 0 citations
Active subspaces identify low-dimensional linear structure in high-dimensional parameter-to-output maps by estimating the dominant eigenspace of a gradient covariance operator. In practice this covariance is replaced by a Monte Carlo estimator built from a limited number of gradient evaluations. Classical analyses based on controlling the covariance error in operator norm lead to sample-complexity estimates that can be substantially more pessimistic than the sampling rules commonly used in computations. This paper studies the empirical active subspace method directly in the projection-error metric relevant for ridge approximation. We derive non-asymptotic quasi-optimality bounds governed by a regularized inverse Christoffel function associated with the gradient field. Under a bounded-gradient assumption, the resulting estimates already improve the sample-complexity estimates obtained from operator-norm covariance bounds. We then show that additional smoothness of the gradient map, expressed through membership in a reproducing kernel Hilbert space, yields sharper coherence estimates and motivates tractable importance sampling from kernel diagonal measures. Furthermore, the same smoothness assumption yields a priori decay bounds for the population active subspace tail energy, which can be combined with our finite-sample estimate to prescribe rank, regularization scale, and sample size, allowing to fully characterize the a priori sample complexity. The abstract assumptions are verified for lognormal Gaussian and affine uniform parametric elliptic PDEs using weighted summability of Hermite and Legendre series expansions.
Fabio Nobile, Matteo Raviola, R. Tempone· 0 citations
Scientific observations are frequently distributed across locations, time periods, and institutions. Combining such observations into a continuous, differentiable field enables recovering governing physical parameters from its derivatives. This paper makes two contributions in this setting. First, the established additive structure of fixed-basis ridge-regression statistics is applied to tensor-product spline fields: each data holder computes a local Gram matrix and moment vector, and the merged solution is mathematically identical to centralized fitting, with no raw data shared and no iterative synchronization. This property is specific to the fixed-feature squared-error setting; the present derivation does not establish an analogous guarantee for general jointly trained multilayer networks. Second, a complete pipeline connects distributed observations to physical parameter inference through field reconstruction, derivative extraction, and linear regression. The pipeline is validated on four PDEs: diffusion, wave, heat-with-source, and the nonlinear viscous Burgers equation, recovering governing parameters to sub-percent accuracy in the linear cases and 5\% for Burgers. In all cases, distributed merging introduces zero degradation relative to centralized fitting. Application to 41 years of NOAA sea-surface temperature data confirms the result on real spatiotemporal observations. Source code to reproduce all experiments is available at https://github.com/NAVEENMN/gramfield.
N. Mysore· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
