Avinash Kumar

The Consistency Optimizer Family: Modulating Parameter Updates via Local Trajectory Alignment

First-order gradient-based optimization is fundamental to training neural networks, yet standard adaptive and momentum-based methods primarily scale parameter updates using historical gradient magnitudes. As a result, they do not explicitly leverage the directional agreement between the current gradient and the accumul...