AURA: Angular Update Rate Adaptation for training complex-valued neural networks
AURA (Angular Update Rate Adaptation), a per-parameter step-size adaptation that can be added on top of any first-order optimizer, and removed from it, without altering its update direction, is introduced.
E. Ballini, A. Engsig-Karup, T. Andriollo
· 0 citations