Preprint
Sep 2026
Efficient Optimization on the Euclidean Sphere: Riemannian Gradient Alignment as a Unifying Principle
It is proved that Riemannian Gradient Descent with diminishing step sizes converges linearly when RGA holds with order $r=1, and at rate $O(k-1/(2r-2)})$ for $r>1$.
Pu-Qian Wang, Nikos Zarifis, Jelena Diakonikolas
· 0 citations