FeDLRT: Federated Dynamical Low-Rank Training
Abstract. We propose a federated dynamical low-rank training (FeDLRT) scheme to reduce client compute and communication costs—two significant performance bottlenecks in horizontal federated learning. Our method builds upon dynamical low-rank time integration schemes for manifold-constrained optimization to create a gl...