Dimensionless Controls of Plasticity Under Alternating Tasks: From Evolutionary Biology to Continual Learning
TL;DR
A minimal deep-learning analogue where a network is trained alternately on two Boolean label sets is studied, and which biological controls of plasticity survive the translation to gradient descent is asked.
Abstract
Plasticity under changing environments is central to both evolutionary biology and continual learning. Motivated by recent work on genotype--phenotype maps, we study a minimal deep-learning analogue where a network is trained alternately on two Boolean label sets, and ask which biological controls of plasticity survive the translation to gradient descent. Reinterpreting four proposed biological factors as quantities of training dynamics, we find the system reduces to two dimensionless controls: the task disagreement $r$, the fraction of disagreeing labels, and the reach $\eta T$, the product of learning rate and switching period. We derive two bounds on plasticity: $r$ alone fixes an extremal geometric floor on the utopia distance, while $r$ and $\eta T$ jointly bound forgetting. Across 9,720 trajectories, an ANOVA confirms that $r$, $\eta$, and $T$ dominate, while the effect of neutral-set size (emphasized in the biological setting) is negligible. The optimal reach itself follows an approximate inverse power law $\eta T^{*}\propto r^{-1.18}$, yielding a heuristic that sets the optimal reach $\eta T^*$ from the task disagreement alone. The analogy that survives is therefore dynamical rather than geometric, and our setting enables a view of plasticity through the lens of other driven systems in physics and engineering.