Skip to content
Preprint

Free-Probability Kernels for Zero-Rollout Hyperparameter Selection in Reservoir Computing

Aug 2026 · 0 citations · 35 references
Computer Science Mathematics

TL;DR

This work introduces a deterministic, pilot-informed selector for leaky linear reservoirs followed by coordinate-wise nonlinear features and positions free-probability kernels as deterministic surrogates for selecting reservoir operating regimes when validation rollouts are scarce.

Abstract

Reservoir computing (RC) couples a fixed recurrent dynamical system with a trained lightweight readout, but this efficiency is partly lost during hyperparameter selection: the recurrent gain, input scale, and leakage rate determine the reservoir's stability and temporal processing regime and are usually tuned through many rollouts. We introduce a deterministic, pilot-informed selector for leaky linear reservoirs followed by coordinate-wise nonlinear features. Free probability yields cross-lag propagation coefficients that summarize how the reservoir mixes past inputs. In the large-width limit, these coefficients define a deterministic temporal kernel that approximates the finite-reservoir feature geometry. Kernel ridge regression on a short labelled pilot sequence therefore ranks candidate operating regimes without instantiating or rolling out a reservoir, and the selected configuration transfers across widths. Across ten synthetic temporal benchmarks, zero-rollout selection obtains a mean deployment score of $0.772$, compared with $0.774$ for exhaustive simulation-based search, while avoiding $156\,600$ selection rollouts. With a small rollout budget, the proposed ranking provides the strongest mean performance at every tested budget and reaches the exhaustive reference using $4.8\%$ of its rollout cost. On four public electricity-transformer-temperature (ETT) forecasting datasets, five retained candidates recover the exhaustive operating point on three datasets. On multivariate cellular-traffic forecasting, 15 rollouts per cell reach the 462-rollout exhaustive reference and outperform random search and Bayesian optimization at low budgets. These results position free-probability kernels as deterministic surrogates for selecting reservoir operating regimes when validation rollouts are scarce.

View source

Similar papers

#artificial intelligence Open access Sep 2026

LoRA-RC: Reservoir Computing with Low-Rank Adaptation

LoRA-RC is proposed, which adapts the recurrent matrix through a low-rank correction driven by streaming prediction errors, and cuts post-drift prediction error by 56% versus a fixed RC and 51% versus readout-only adaptation.

Wen-Bin Wan · 0 citations
#edge computing Preprint Sep 2026

Determinants of hyperparameter robustness in connectome reservoir computing

To examine the architectural determinants of robustness, perturbations that alter connectivity topology, excitatory/inhibitory sign structure, weight magnitudes, and weight placement are constructed while preserving complementary properties.

Miles Walter Churchland, R. de Palma Aristides, Jordi Garcia-Ojalvo et al. · 0 citations
Preprint Aug 2026

TinyCast: Probabilistic Zero-Shot Forecasting with Computed Periodicity

We introduce TinyCast, an attention-free zero-shot forecaster that emits a predictive distribution from 146,505 parameters, on the premise that at this size the periodic structure of a context is worth computing rather than learning. A zero-parameter spectral detector supplies the dominant periods, the context is folde...

A. Steinhauser · 1 citation · ⚡1
Preprint Aug 2026

Hybrid Neural-Classical Correction for Frozen Time Series Foundation Models: A Comprehensive Ablation Study on High-Frequency Stock Prediction

A comprehensive study of hybrid neural-classical correction for adapting frozen TimesFM to stock return prediction during the volatile opening trading hour, with classical methods playing a crucial complementary role.

Kasun Dewage, Suranadi De Silva, Shankhadeep Mondal · 0 citations
Preprint Aug 2026

Finite-Horizon Input-Output Dynamics of Minibatch Perturbations in AdamW

This work forms AdamW as a finite-horizon input--state--output (ISO) system whose state contains the model parameters and first- and second-moment estimates, and derives an exact multistep error decomposition and establishes first-order finite-horizon accuracy under local smoothness and controlled activation switching.

Kangning Liu, Su-Yan Li · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.