This work proposes applying model partitioning, which can shift energy consumption by offloading parts of a model to another participant, in response to carbon- or grid-aware signals, in response to carbon- or grid-aware signals.
Abstract
As federated learning (FL) extends from distributed machine learning between low-power devices to cross-silo scenarios involving edge servers and data centres, its carbon footprint has become a growing concern. Addressing this, methods for sustainable FL align training with low-carbon energy availability or low grid demand and reduce the energy consumption of clients powered by high-carbon sources by decreasing the size of their models. We propose applying model partitioning, which can shift energy consumption by offloading parts of a model to another participant, in response to carbon- or grid-aware signals. Our preliminary findings show that for some partition points, model partitioning can reduce a participant's energy consumption by up to 76% without any significant time or energy consumption overhead compared to non-partitioned training.
A weighted Federated Averaging aggregation scheme which aims to highlight the potential benefits of positively weighing clients who contain more homogeneous data and the preliminary results exhibit that when clients with more homogeneous data are weighed higher, the global model can achieve better performance, but that...
B. Santos, Julian Templeton, Rafik Chemli Statistics Canada et al.· 0 citations
The Air-FedSNN framework, which integrates slimmable neural networks (SNNs) with over-the-air computation (AirComp) to improve communication, computation, and energy efficiency in heterogeneous IoT networks, and provides an efficient solution for resource-constrained environments.
Yue Zhang, Guopeng Zhang, Ke-Zhi Wang et al.· IEEE Journal on Selected Are...· 0 citations
An asynchronous framework named FedQS, which employs a multi-dimensional staleness evaluation mechanism that dynamically assesses updates by combining the similarity between local and global models with client latency metrics, and implements a decoupling solution via a queue scheduling algorithm to resolve the coupling...
Jia-Hui Zhou, Fang Li, Tian-Yu Shi et al.· Journal of Cloud Computing· 0 citations
The Federated Parallel Scaling (FPS) algorithm is proposed, which jointly trains multiple sampled subnetworks in parallel with self-distillation so that larger sampled subnetworks can supervise smaller ones during local updates.
Jia-Xin Zhang, Xing-Wei Wang, Bo Yi et al.· 0 citations
This paper presents a comprehensive architectural framework for scalable data engineering tailored for FL in heterogeneous and resource-constrained environments and proposes a modular architecture that addresses data heterogeneity, scalability, and compliance.
Laura Conti, Andrew Collins· International Journal of Dat...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.