Convergence of Practical Muon
This paper interprets practical Muon as right-preconditioned optimization of the original loss with a dynamic weighted $\ell_2$ regularizer that vanishes as stationarity is approached, so that the optimization target remains the original objective and establishes the first convergence guarantee for practical Muon in th...