Plasticity Dynamics Improves Reservoir Performance on Mixed-Timescale Memory Tasks
TL;DR
This work introduces Hebbian plasticity into recurrent networks and shows that its dynamics enable the reservoir to simultaneously process fast and slow components of mixed-timescale inputs: neuronal dynamics encode fast fluctuations, while synaptic dynamics support slower components.
Abstract
Mixed-timescale signals are ubiquitous in natural stimuli and real-world applications, yet they remain challenging to process with recurrent neural networks. Reservoir computing offers an efficient framework for temporal processing, but extending its temporal range typically requires tuning neuronal timescales, which can compromise the representation of faster dynamics. Here, we propose an alternative approach in which synaptic plasticity provides an additional, slower timescale for computation. We introduce Hebbian plasticity into recurrent networks and show that its dynamics enable the reservoir to simultaneously process fast and slow components of mixed-timescale inputs: neuronal dynamics encode fast fluctuations, while synaptic dynamics support slower components. Remarkably, the resulting computational benefit extends over more than an order of magnitude beyond the intrinsic timescale of the plasticity. We show that this extended processing range arises from the dependence of the plasticity rule on postsynaptic activity, which effectively injects a filtered memory of past states into the network current. These results identify synaptic plasticity as a mechanism for extending the temporal processing capabilities of recurrent networks without altering neuronal timescales, and also suggest a potential computational role for plastic synapses in the processing of slowly varying stimuli in biological neuronal networks.