This work introduces a deterministic, pilot-informed selector for leaky linear reservoirs followed by coordinate-wise nonlinear features and positions free-probability kernels as deterministic surrogates for selecting reservoir operating regimes when validation rollouts are scarce.
Abstract
Reservoir computing (RC) couples a fixed recurrent dynamical system with a trained lightweight readout, but this efficiency is partly lost during hyperparameter selection: the recurrent gain, input scale, and leakage rate determine the reservoir's stability and temporal processing regime and are usually tuned through many rollouts. We introduce a deterministic, pilot-informed selector for leaky linear reservoirs followed by coordinate-wise nonlinear features. Free probability yields cross-lag propagation coefficients that summarize how the reservoir mixes past inputs. In the large-width limit, these coefficients define a deterministic temporal kernel that approximates the finite-reservoir feature geometry. Kernel ridge regression on a short labelled pilot sequence therefore ranks candidate operating regimes without instantiating or rolling out a reservoir, and the selected configuration transfers across widths. Across ten synthetic temporal benchmarks, zero-rollout selection obtains a mean deployment score of $0.772$, compared with $0.774$ for exhaustive simulation-based search, while avoiding $156\,600$ selection rollouts. With a small rollout budget, the proposed ranking provides the strongest mean performance at every tested budget and reaches the exhaustive reference using $4.8\%$ of its rollout cost. On four public electricity-transformer-temperature (ETT) forecasting datasets, five retained candidates recover the exhaustive operating point on three datasets. On multivariate cellular-traffic forecasting, 15 rollouts per cell reach the 462-rollout exhaustive reference and outperform random search and Bayesian optimization at low budgets. These results position free-probability kernels as deterministic surrogates for selecting reservoir operating regimes when validation rollouts are scarce.
LoRA-RC is proposed, which adapts the recurrent matrix through a low-rank correction driven by streaming prediction errors, and cuts post-drift prediction error by 56% versus a fixed RC and 51% versus readout-only adaptation.
Wen-Bin Wan· IEEE Control Systems Letters· 0 citations
To examine the architectural determinants of robustness, perturbations that alter connectivity topology, excitatory/inhibitory sign structure, weight magnitudes, and weight placement are constructed while preserving complementary properties.
Miles Walter Churchland, R. de Palma Aristides, Jordi Garcia-Ojalvo et al.· 0 citations
We introduce TinyCast, an attention-free zero-shot forecaster that emits a predictive distribution from 146,505 parameters, on the premise that at this size the periodic structure of a context is worth computing rather than learning. A zero-parameter spectral detector supplies the dominant periods, the context is folde...
A comprehensive study of hybrid neural-classical correction for adapting frozen TimesFM to stock return prediction during the volatile opening trading hour, with classical methods playing a crucial complementary role.
Kasun Dewage, Suranadi De Silva, Shankhadeep Mondal· 0 citations
This work forms AdamW as a finite-horizon input--state--output (ISO) system whose state contains the model parameters and first- and second-moment estimates, and derives an exact multistep error decomposition and establishes first-order finite-horizon accuracy under local smoothness and controlled activation switching.
It is demonstrated that exposing recent reservoir evolution at the decoder can substantially reduce the limitations of stepwise decoding while retaining the standard reservoir computing protocol.
Shi-Meng Wu, Andrew Walter, Andy M. Tyrrell et al.· npj Unconventional Computing· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.