Preprint
Aug 2026
Finite-Horizon Input-Output Dynamics of Minibatch Perturbations in AdamW
This work forms AdamW as a finite-horizon input--state--output (ISO) system whose state contains the model parameters and first- and second-moment estimates, and derives an exact multistep error decomposition and establishes first-order finite-horizon accuracy under local smoothness and controlled activation switching.
Kangning Liu, Suyan Li
· 0 citations