Daiki Iwade

Linesearch-Free Nonlinearly Preconditioned GD with Semiautomatic Geometry Design

Nonlinear preconditioning makes it possible to adapt gradient updates to the growth of the objective's curvature, but combining its design with suitable stepsize selection is challenging. We propose adaptive dual preconditioned gradient descent (adaptive DPGD), which combines curvature-based preconditioner design with...