Xiao-Guang Niu

Anon: Extrapolating Adaptivity Beyond SGD and Adam

Anon is proposed, an optimizer that achieves fully continuous adaptivity extrapolation across the entire real-number spectrum and demonstrates highly competitive and scalable performance among state-of-the-art element-wise optimizers on representative image classification, diffusion, and large language modeling tasks.