Predicting Block-Coordinate Performance via Cross-Curvature
Simultaneous and sequential block updates are two basic optimization strategies used across machine learning, such as neural-network training, federated learning, and low-rank adaptation. Choosing between them is difficult because their relative advantage depends on both the objective geometry and the number of iterati...
Sheng-Kun Zhu, Jin-Shan Zeng, Zhi Kou et al.
· 0 citations