Skip to content
Preprint

Could Model Partitioning Make Federated Learning More Sustainable?

Aug 2026 · 0 citations · 21 references
Computer Science

TL;DR

This work proposes applying model partitioning, which can shift energy consumption by offloading parts of a model to another participant, in response to carbon- or grid-aware signals, in response to carbon- or grid-aware signals.

Abstract

As federated learning (FL) extends from distributed machine learning between low-power devices to cross-silo scenarios involving edge servers and data centres, its carbon footprint has become a growing concern. Addressing this, methods for sustainable FL align training with low-carbon energy availability or low grid demand and reduce the energy consumption of clients powered by high-carbon sources by decreasing the size of their models. We propose applying model partitioning, which can shift energy consumption by offloading parts of a model to another participant, in response to carbon- or grid-aware signals. Our preliminary findings show that for some partition points, model partitioning can reduce a participant's energy consumption by up to 76% without any significant time or energy consumption overhead compared to non-partitioned training.

View source

Similar papers

Exploring aggregation strategies for federated learning in national statistics 1

A weighted Federated Averaging aggregation scheme which aims to highlight the potential benefits of positively weighing clients who contain more homogeneous data and the preliminary results exhibit that when clients with more homogeneous data are weighed higher, the global model can achieve better performance, but that...

B. Santos, Julian Templeton, Rafik Chemli Statistics Canada et al. · 0 citations
Open access 2026

Optimizing Federated Learning Efficiency via Slimmable Neural Networks and AirComp for Resource-Heterogeneous Devices

The Air-FedSNN framework, which integrates slimmable neural networks (SNNs) with over-the-air computation (AirComp) to improve communication, computation, and energy efficiency in heterogeneous IoT networks, and provides an efficient solution for resource-constrained environments.

Yue Zhang, Guopeng Zhang, Ke-Zhi Wang et al. · 0 citations
#federated learning Open access Sep 2026

FedQS: asynchronous federated learning based on queue scheduling

An asynchronous framework named FedQS, which employs a multi-dimensional staleness evaluation mechanism that dynamically assesses updates by combining the similarity between local and global models with client latency metrics, and implements a decoupling solution via a queue scheduling algorithm to resolve the coupling...

Jia-Hui Zhou, Fang Li, Tian-Yu Shi et al. · 0 citations
#machine learning Preprint Sep 2026

FANS: Federated Adaptive Network Search Learning for Heterogeneous Devices

The Federated Parallel Scaling (FPS) algorithm is proposed, which jointly trains multiple sampled subnetworks in parallel with self-distillation so that larger sampled subnetworks can supervise smaller ones during local updates.

Jia-Xin Zhang, Xing-Wei Wang, Bo Yi et al. · 0 citations
Open access 2021

Scalable Data Engineering Architectures for Federated Learning in Decentralized Cloud Environments

This paper presents a comprehensive architectural framework for scalable data engineering tailored for FL in heterogeneous and resource-constrained environments and proposes a modular architecture that addresses data heterogeneity, scalability, and compliance.

Laura Conti, Andrew Collins · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.