Peng-Fei Li

Beyond Uniform Compression: Budgeted Transmission Allocation for Extreme Federated Learning

Federated learning faces severe communication bottlenecks when clients upload high-dimensional model updates. Existing methods often compress these updates uniformly across all layers. This uniform approach ignores the heterogeneous value of different parameter blocks and wastes limited bandwidth on insensitive layers....