Wenpeng Zhang

Matrix AdaGrad: Row-wise and Column-wise Adaptive Subgradient Methods

An Online Mirror Descent framework with adaptive proximal functions for matrix-valued parameters, providing a principled methodology for deriving matrix-aware adaptive optimization through online regret minimization and yields Row-wise Matrix AdaGrad and Column-wise Matrix AdaGrad as concrete instantiations with regret...