2026· IEEE Transactions on Communications· Vol 74, pp. 10709-10725· 1 citation· 40 references
Computer Science
Abstract
The escalating complexity of deep neural networks introduces substantial challenges to deploying federated learning (FL) in resource-limited edge environments. To address these limitations, split federated learning (SFL) has emerged as a promising paradigm, alleviating client-side computational and communication burdens via strategic model splitting, and periodically aggregating client-side and server-side models consistent with the principles of FL. Nevertheless, existing SFL frameworks encounter significant performance degradation arising from data heterogeneity and imbalance, client heterogeneity, as well as constrained wireless resources. To overcome these issues, this paper introduces a novel data distribution deviation-aware split federated learning (DA-SFL) framework. DA-SFL dynamically adjusts aggregation weights according to the deviation of clients’ data distributions from a global distribution, effectively mitigating biases induced by data imbalance and heterogeneity. Furthermore, we theoretically establish the convergence bound of DA-SFL under a non-convex loss function setting, demonstrating that minimizing the data deviation in each training round enhances learning efficacy. Motivated by this, we formulate a mixed-integer nonlinear programming to optimize learning performance under long-term energy constraints. Leveraging the Lyapunov optimization framework, we decompose the problem into a series of tractable subproblems in each learning round, and propose efficient algorithms to find the client scheduling, adaptive cut layer selection, bandwidth allocation, and aggregation weighting policies. Extensive experimental evaluations conducted on Fashion-MNIST, CIFAR-10, and CINIC-10 datasets across diverse scenarios of data heterogeneity and imbalance demonstrate that DA-SFL significantly outperforms baselines regarding test accuracy, time and energy efficiency, while exhibiting notable robustness and scalability.
Nowadays, split federated learning (SFL) has emerged as an effective paradigm for enabling privacy-preserving collaborative intelligence across heterogeneous devices with limited computation. However, SFL incurs significant communication overhead in wireless networks due to the uplink transmission of high-dimensional smashed data, which degrades network efficiency. To mitigate the communication bottleneck, we propose a prototype-based SFL framework ProtoSFL. Specifically, each selected client computes local prototypes for observed classes and uploads them to the server. Based on the received prototypes, the server derives global prototypes and optimizes a weighted objective that combines classification loss with prototype alignment loss. The server then updates the model accordingly and returns personalized prototype gradients to the clients. Simulation results verify the effectiveness of ProtoSFL in reducing communication overhead, achieving a substantial reduction in uplink communication, while maintaining competitive testing accuracy under various heterogeneous data settings compared with SFL baselines.
A green quantized FSL (GQ-FSL) framework that incorporates stochastic quantization for both local collaborative training and wireless transmissions and enables large-scale DNN deployment on resource-constrained devices, achieving superior energy efficiency compared to quantized federated learning and full-precision FSL.
Federated learning (FL) applications normally employ large deep learning (DL) models, resulting in excessive communication overhead in the deployment of FL over resource-constraint mobile edge networks. To achieve better scalability for DL-based FL, we capitalize on both the asymmetric nature of mobile networks and the distinct effects of partial transmissions on FL training for the global and local models. We propose Fed-DynAmal, an FL framework that decreases the number of parameters transmitted in the uplink (clients-to-server) while concurrently achieving better model performance. The underlying idea is that each selected client sends a partial DL model to the server by omitting several sub-blocks from the trained local model. Crucially, we drop the assumption that transmitted local models can still be used for inference, thereby allowing for greater model variability. At the server, we introduce amalgamation, a process to merge different partial local models into an inference-viable full model. Essentially, amalgamation is a bridge for performing aggregation at the sub-block level. Interestingly, as the key takeaway, communication efficiency versus model performance is not necessarily a trade-off in FL: Our extensive experiments show that Fed-DynAmal can effectively improve communication efficiency while still concurrently achieving higher accuracy and enhanced robustness.
Zihan Chen, H. Yang, Tony Q. S. Quek et al.· IEEE Transactions on Cogniti...· 0 citations
Results support the central conclusion that lightweight joint scheduling can materially improve wall-clock FL efficiency in heterogeneous 5G/6G edge networks.