A green quantized FSL (GQ-FSL) framework that incorporates stochastic quantization for both local collaborative training and wireless transmissions and enables large-scale DNN deployment on resource-constrained devices, achieving superior energy efficiency compared to quantized federated learning and full-precision FSL.
Abstract
Deploying state-of-the-art deep neural networks (DNNs) at the wireless edge is severely bottlenecked by the strict energy and resource constraints of mobile devices. Although federated split learning (FSL) alleviates on-device computational burdens by offloading workloads to an edge server, this may introduce systemic overheads, while the continuous exchange of intermediate activations, gradients, and submodels still incurs significant energy consumption (EC). To address this, we propose a green quantized FSL (GQ-FSL) framework that incorporates stochastic quantization for both local collaborative training and wireless transmissions. Notably, GQ-FSL supports asymmetric precision levels for the client- and server-side submodels, effectively decoupling device energy constraints from global convergence degradation. To quantify these tradeoffs, we develop parameterized energy models for the split architecture and derive a theoretical convergence bound under statistically heterogeneous data. Building on that, we formulate a joint optimization problem to configure the DNN split point and precision levels, minimizing the total system EC while satisfying strict latency and target accuracy constraints. Ultimately, we demonstrate that GQ-FSL enables large-scale DNN deployment on resource-constrained devices, achieving superior energy efficiency compared to quantized federated learning and full-precision FSL.
Federated learning (FL) applications normally employ large deep learning (DL) models, resulting in excessive communication overhead in the deployment of FL over resource-constraint mobile edge networks. To achieve better scalability for DL-based FL, we capitalize on both the asymmetric nature of mobile networks and the...
Zi-Han Chen, H. Yang, Tony Q. S. Quek et al.· IEEE Transactions on Cogniti...· 0 citations
With the emergence of next-generation communication technologies, the integration of AI into next-generation wireless networks is becoming an important step toward achieving distributed intelligence. Different distributed learning frameworks, such as federated learning (FL) and split learning (SL), enable collaborative...
Zhe Wang, Sige Liu, Nikolaos G. Bartzoudis et al.· IEEE Communications Letters· 0 citations
Nowadays, split federated learning (SFL) has emerged as an effective paradigm for enabling privacy-preserving collaborative intelligence across heterogeneous devices with limited computation. However, SFL incurs significant communication overhead in wireless networks due to the uplink transmission of high-dimensional s...
Energy-Aware Adaptive Quantization and Freezing (EA-AQF), a unified framework that co-optimizes communication and computation, is presented, a unified framework that co-optimizes communication and computation and maintains robust convergence in highly heterogeneous tasks.
Integrating over-the-air computations into the model aggregation process of federated learning (FL) offers a promising solution to mitigate the communication bottleneck in FL model training. In this approach, all the clients modulate their intermediate parameters, such as gradients, onto the same set of orthogonal wave...
Jiaqi Zhu, H. Yang, Nikolaos Pappas et al.· IEEE Transactions on Wireles...· 0 citations
Low earth orbit (LEO) satellite networks have emerged as a key enabler for delivering real-time and global services to distributed terrestrial nodes, particularly in remote regions. To preserve data privacy, federated learning (FL) provides a decentralized framework for advancing artificial intelligence (AI) in complex...
Pengxiang Qin, Dongyang Xu, Lei Liu et al.· IEEE Transactions on Cogniti...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.