Hai-Lin Sun

A Stochastic Recursive Gradient Algorithm with Random Barzilai-Borwein Step Size for Convex Optimization

The stochastic recursive gradient algorithm (SARAH) has garnered considerable attention owing to its implementation of a straightforward recursive framework for stochastic gradient updates. Motivated by this, we propose to integrate the importance sampling strategy with mini-batch techniques into the SARAH framework, d...