The internal model principle in reservoir computing

Abstract

The paper studies learning in reservoir computing systems through the lens of the internal model principle. The key idea is to model training signals as outputs of an exogenous signal generator, thus connecting reservoir computing to output regulation, observer theory, and frequency-domain interpolation. For linear signal generators, we characterize the steady-state response of a linear reservoir through invariant subspaces, establishing connections with Luenberger observers and classical frequency-domain interpolation. For nonlinear signal generators, we obtain analogous results using invariant manifolds, connecting synchronization to Kazantzis-Kravaris/Luenberger observers and readout training to nonlinear moment matching. Case studies illustrate how our perspective explains possible instability of trained predictors and informs reservoir design.