Jun 2026
Gradient Smoothing: Coupling Layer-wise Updates for Improved Optimization
Depth-wise Gradient Augmentation is established as a promising framework for exploiting cross-depth structure in optimization and Gradient Smoothing is demonstrated as a simple and broadly applicable instantiation.
Haoming Meng, Anton Sugolov, Vardan Papyan
· arXiv.org · 0 citations