This paper proposes an ML-based approach to search for structure in dynamical systems using Neural Input Optimization (NIO), and discusses the methodology and presents promising results.
Abstract
The world consists of many dynamical and chaotic systems whose underlying functions can be highly nonlinear. Traditional engineering and scientific methods emphasize simplifying problems, sometimes to the point that valuable information may be lost. Instead, understanding of these systems may require analysis of the underlying dynamics. In the past, the technique of discovering and analyzing strange attractors has yielded some success. However, much work is still needed. Machine learning (ML)-based models such as deep neural networks which are based on nonlinear functions may provide a great set of techniques to help in the discovery of structure in dynamical systems. In this paper, we propose an ML-based approach to search for structure in dynamical systems using Neural Input Optimization (NIO). We discuss our methodology and present promising results. Quantitative results help to validate our proposed NIO methodology for structure discovery.
This study investigates the capability of deep neural networks to infer the time-evolution of the Rössler system a canonical chaotic oscillator by leveraging initial conditions and forcing parameters as input variables and underscores the need for hybrid approaches to address long-term instability.
A. Fateh, Harrag Abdelmalek, F. Mohamed et al.· International Journal of App...· 0 citations
Multi-step training of sparse, interpretable models of dynamical systems directly from time-series data yields models with accurate short-term dynamics and strong agreement in long-time statistical properties, including mean, variance, and Lyapunov exponents.
A number of methods have been proposed to solve the problems of noise, irregular sampling, etc., in high-dimensional chaos, and their respective advantages are introduced below.
Ming-Yang Wang· Theoretical and Natural Scie...· 0 citations
It is proved that, under certain assumptions, a reservoir that has learned topologically semiconjugate in a weak sense or topologically conjugate to [Formula] becomes topologically semiconjugate in a weak sense or topologically conjugate to [Formula]: see text.
It is shown that training the input-to-hidden weights yields a smaller generalization error than keeping them fixed, indicating that singularities play an essential role even in wide neural networks.
Spectral submanifolds can be used to reduce recurrent neural networks to low-dimensional models, revealing their core dynamics, and authors uncover robust structures underlying decision-making and working-memory tasks, providing predictions about the underlying behavior of neural computations.
A. Marraffa, R. Krause, V. Mante et al.· Nature Communications· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.