Wan-Li Hong

Multi-Step Performance Estimation for Gradient Descent under the Polyak Lojasiewicz Condition

Gradient descent is a fundamental algorithm in machine learning and statistical inference. Performance estimation provides a systematic framework for obtaining sharp convergence bounds through semidefinite programming. We study the worst-case performance of constant-stepsize gradient descent over the class of $L$-smoot...