Optimal Deterministic First-Order Oracle Complexity for Nonconvex-Concave Minimax Optimization
Abstract
We study the deterministic first-order oracle complexity of smooth nonconvex-concave minimax optimization over a bounded convex dual domain. Let $\ell$ denote the joint smoothness constant, $D_{\mathcal{Y}}$ the diameter of the dual domain, and $\Delta$ the initial gap. We prove that every deterministic first-order algorithm requires $\Omega(\ell^2D_{\mathcal{Y}}\Delta/\epsilon^3)$ oracle queries in the worst case to find an $\epsilon$-optimization-stationary point whenever $\epsilon\lesssim\min\{\ell D_{\mathcal{Y}},\sqrt{\ell\Delta}\}$. We then develop Tracked-FOAM, a first-order method that attains a matching upper bound, removing the logarithmic factor from previous upper bounds. Together, these results establish the optimal dependence on all problem parameters in the stated regime.