This paper proposes a framework that combines a Variational Autoencoder, with a convolutional or graph basis that reduces the dimensionality of the system, and provides an inbuilt uncertainty quantification for targeted experiment design.
Abstract
Dynamic simulations are an entrenched way of gaining insight into the evolution of system dynamics. Their computational cost however is often prohibitively high, especially in cases of stochastic frameworks. Machine learning algorithms are especially suited as simulation surrogates. Nevertheless, they face some very distinct limitations. Firstly, the sheer dimensionality of these systems, however, precludes the use of traditional time series models who struggle with high dimensional feature spaces. Additionally, traditional time series focus exclusively on either long or short range effects, causing local or global drift given enough time. In this paper, we propose a framework that addresses those limitations. Our framework combines a Variational Autoencoder, with a convolutional or graph basis that reduces the dimensionality of the system. This latent vector is propagated in time using a Temporal Fusion Transformer model, which includes both long range and short range effect encoding, as well as static covariate support. We test our framework on three distinct cases, to prove its robustness and in all three we have achieved practically identical to the simulation results at a fraction of the time. Further, our framework is flexible enough to be adapted to any new system and provides an inbuilt uncertainty quantification for targeted experiment design.
VI-SINDy is proposed, a novel inference framework that integrates variational integration (VI) with the sparse identification of dynamical systems with the aim of extending the applicability of data-driven modeling to complex dynamic environments.
Deep learning surrogates have become powerful tools for simulating and forecasting complex dynamical systems, yet their utility remains limited by catastrophic error accumulation during long-term autoregressive rollouts. This behavior is partly tied to the nature of the underlying systems: chaotic spatiotemporal system...
While stochastic diffusion samplers such as DDPM better preserve the enstrophy spectrum during rollouts in the stochastic setting, deterministic samplers such as DDIM and DPM-2 show better spectral preservation in the deterministic setting.
S. Pfister, Benjamin J. Holzschuh, Nils Thuerey· 2 citations
This work infer the initial latent state directly from a small set of early-time observations, treating latent-state initialization as an adaptation problem, and investigates two strategies: an auto-decoding formulation and a meta-learning approach in which the initial latent state acts as a task-specific context varia...
Stefano Maria Pizzamiglio, S. Pagani, Francesco Regazzoni· 1 citation
The dynamics of cells, organisms, and fluids are often modeled as probability distributions evolving over time. Reconstructing and extrapolating this evolution from unpaired snapshots requires assumptions about the underlying process. Wasserstein gradient flows are a common choice, but they cannot describe conservative...
F. Sergeev, Markus Heinonen, Daniel Waxman et al.· 1 citation
This work derives a parameterizable evolutionary spectra formulation, recasting non-stationary random process modeling as learning an evolving representation modulated by random variables, and reduces the complexity of the estimated spectra from O(NM) to O(NK), where K<<M/2.
Wei-Wei Ye, Ren-He Jiang, Hang-Chen Liu et al.· 0 citations