Skip to content

Sensitivity-Constrained Neural Operators for Data-Efficient Forward and Inverse Modeling of Partial Differential Equation Systems

Aug 2026 · 0 citations
Computer Science

TL;DR

Results support sampled sensitivity supervision as a practical way to improve neural PDE surrogates when forward accuracy, inverse stability, robustness, and computational cost must be considered together.

Abstract

Neural operators provide fast surrogates for partial differential equation (PDE) solvers, but their reliability can degrade for high-dimensional spatial inputs and inverse or repeated inference. State-only training constrains solution values but not the learned input--output response. We study sensitivity-constrained neural operators (SC-NOs), which augment standard training with sampled solver-derived Jacobian supervision. Selected sensitivities from differentiable solvers or discrete adjoints are matched during training, allowing response information to be amortized across minibatches without imposing the full Jacobian at every update. We evaluate SC-NO on advection--diffusion and RANS--Spalart--Allmaras benchmarks, input-dimensionality scaling tests, long-horizon autoregressive rollout, and a shallow-water Tohoku tsunami source-inversion case. Sensitivity supervision improves forward prediction and yields larger gains in gradient-based inverse reconstruction of distributed fields. Scaling experiments show an improved accuracy--cost tradeoff for high-dimensional gridded inputs, while ablations indicate that state values and Jacobian information provide complementary supervision. In the tsunami case, SC-FNO reconstructs gridded seafloor deformation from sparse early gauge observations and forecasts subsequent wave propagation in a near-real-time proof-of-concept workflow. These results support sampled sensitivity supervision as a practical way to improve neural PDE surrogates when forward accuracy, inverse stability, robustness, and computational cost must be considered together.

View source

Similar papers

#machine learning Preprint Sep 2026

Single-condition neural solvers encode transferable response spaces for parametric differential equations

This work shows that the output Jacobian of a neural solution model trained at one condition defines a reusable response space for cross-condition solution variations, and introduces Linearized Subspace Transfer (LST) to exploit this space and recover target solutions by minimizing the target PDE-system residual over r...

Wen-Bo Cao, Wei-Wei Zhang · 0 citations
#machine learning Preprint Sep 2026

Local gradient neural operator

This work proposes the local gradient neural operator (LGNO) as a lightweight and interpretable alternative for field temporal evolution prediction and source identification in typical mechanical problems and exhibits wide applicability to mechanical problems including diffusion, flow, and quantum phenomena.

Bai-Ming Zhang, Jin-Song Tang, Ying Xu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Transolver-$\sigma$: Joint Spectral-Physical Subspace Modeling for Neural PDE Solving

Across five well-established PDE benchmarks spanning steady-state prediction and time-dependent dynamics, Transolver$ achieves state-of-the-art with a benchmark-averaged relative error reduction of 33.4% over the strongest baseline for each metric, while consistently improving autoregressive rollout over single-operato...

Haonan Shangguan, Hang Zhou, Haixu Wu et al. · 0 citations
Open access Sep 2026

Bayesian bilevel operator learning with low-rank adaptation for efficient uncertainty quantification of PDE inverse problems

A Bilevel Local Operator Learning framework for Bayesian inference in PDEs (B-BiLO), which enables efficient gradient-based sampling without synthetic data or adjoint equations and avoids sampling in high-dimensional weight space, as in Bayesian neural networks, by optimizing weights deterministically.

Ray Zirui Zhang, Christopher E. Miles, Xiao-Hui Xie et al. · 0 citations
#machine learning Preprint Sep 2026

Equation Recast for Canonical Operator Learning Across Parametric PDEs

Equation recast is introduced, which reformulates parametric operator learning as the learning of a single canonical operator, and provides a route toward reusable neural PDE solvers combining equation-guided transfer, data efficiency, and monitorable inference.

Qi-Yun Cheng, Valentin Duruisseaux, C. Clauser et al. · 0 citations

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.