Category
federated learning
150 papers
Research on Privacy Protection of Digital Twin Intelligence Based on Big Data in 5G System Security
Digital twin (DT) technology is becoming a foundational component of next-generation 5G and 6G networks, enabling real-time monitoring, predictive analytics, and collaborative research. However, integrating DTs with big data and AI introduces significant privacy, security, and governance challenges. This article presents a privacy-preserving DT intelligence framework that integrates federated learning (FL) and differential privacy (DP) within a secure, standards-based architecture. The design follows ISO/IEC 27001 for information security management, complies with EU GDPR principles for data minimization and consent, and aligns with 3GPP TS 33.501 security procedures for 5G networks. The architecture combines TLS-secured data ingestion, blockchain-backed audit trails, and policy-driven compliance monitoring to ensure trusted DT operations without centralizing sensitive data. By mapping key threat vectors to corresponding international standards, the framework offers a practical blueprint for secure and interoperable DT deployments. The article concludes with deployment considerations and a roadmap for extending existing standards to support AI-native digital twins in future 6G environments.
Efficient Backdoor Mitigation in Federated Learning With Contrastive Loss
The rapid adoption of Internet of Things (IoT) devices has accelerated the need for privacy-preserving machine learning techniques, such as federated learning (FL). However, the decentralized and collaborative nature of FL makes it vulnerable to backdoor attacks, where adversaries locally update their malicious models before contributing to the global aggregation, subtly injecting backdoors without degrading the normal performance. An affected model behaves as expected during regular operations but exhibits malicious behavior when an embedded trigger is presented. In this article, we propose a novel self-supervised contrastive-learning-based approach to detect and mitigate backdoor attacks in FL within IoT environments. Unlike conventional reverse-engineering methods that iterate through each class in the dataset to reconstruct triggers, our approach directly regenerates triggers from compromised global models without class iteration. This is achieved by comparing last-layer feature representations of a potentially compromised model with those of a relatively clean model under the guidance of contrastive loss. The reverse-engineered trigger is then leveraged to patch the global model and remove the backdoors. We evaluate our method on three benchmark datasets under two federated backdoor attack scenarios, simulating IoT device collaborations. Extended experiments are also conducted on a transformer-based model and two mitigation methods to assess the robustness of our approach. Our results demonstrate that while traditional reverse-engineering techniques are effective in centralized settings, they struggle to detect backdoors in FL. Comparatively, our method is resilient against backdoor attacks across various settings. In addition, our method is more time-efficient because of its capability of generating the backdoor trigger directly without iterating through all classes.
A Blockchain-Based Federated Learning Approach for Electricity Theft Detection Through Dual-Verification
Malicious clients participating in data collection and interaction may launch attacks such as model and data poisoning to degrade the performance of the global model and conceal their electricity theft behaviors. Although existing studies have introduced blockchain technology to achieve decentralization, they still suffer from limited pre-aggregation validation dimensions. To address these issues, this paper proposes a blockchain-based federated learning approach with dual-verification (BFL-DV) for electricity theft detection. In the pre-aggregation stage, a multi-metric reputation-based consensus committee verification strategy is designed, which effectively mitigates the impact of malicious participants. In the post-aggregation stage, a dynamic threshold-based blockchain verification strategy is developed to counter security risks during the transmission process, which can refuse malicious global updates adaptively. Experimental results demonstrate that BFL-DV can accurately reduce the impact of all malicious clients under the data poisoning attack. Notably, across various proportions of malicious clients, the proposed framework achieves an average AUC improvement of 32.68% compared with SOTA methods, demonstrating its consistent performance advantage.
Reach audiences
Advertise in front of researchers, engineers, and readers.
A Spatiotemporal Coupling-Based Clustered Federated Learning Scheme for Low Latency Digital Twin Within Heterogeneous IIoT
Data-driven deep learning (DL) techniques have increasingly been employed to construct digital twin (DT) models for the intelligent industrial Internet of Things (IIoT) systems. Within DTs, federated learning (FL) offers a decentralized framework that enables distributed entities to collaboratively update global models without sharing raw data. Clustered FL (CFL) further enhances training efficiency by grouping clients, thereby reducing communication overhead and accelerating model convergence. However, data heterogeneity arising from spatial distribution differences and system heterogeneity, resulting in straggler clients, jointly hinder the convergence and efficiency of CFL. The interplay of these factors introduces spatiotemporal coupling, which further degrades model training. To address these challenges, we propose a spatiotemporal coupling-based CFL scheme that jointly optimizes client clustering and aggregation strategies to minimize overall training latency. A semisynchronous aggregation mechanism is introduced, allowing clients to update at different frequencies based on their delay tiers. Furthermore, client clustering is performed according to location similarity to improve convergence, while clients with higher delay tiers and greater data diversity are prioritized for cluster head selection. To mitigate the impact of imbalanced cluster sizes under data heterogeneity, a balanced matching optimization is formulated to evenly distribute remaining clients to the nearest cluster heads. Within each cluster, adaptive bandwidth allocation is employed to satisfy delay-tier constraints and shorten communication rounds. Extensive simulations on CIFAR-10 and Fashion-MNIST with nonindependent and identically distributed settings show that the proposed scheme can reduce the total training latency by up to 38.71% and 8.87%, respectively, to reach a fixed target accuracy, while achieving comparable model accuracy to existing baselines. These results confirm the effectiveness of the proposed scheme in heterogeneous IIoT environments.
CSFL: Communication-Efficient Semi-Asynchronous Federated Learning Method in Resource-Constrained Edge Computing
Federated learning (FL) is a distributed machine learning (ML) paradigm that has been widely used to train ML models on massive amounts of data in edge computing (EC) environments. However, FL faces significant challenges from device heterogeneity, edge dynamics, and limited communication resources. To address these challenges, we propose a communication-efficient semi-asynchronous FL (CSFL) framework. First, the work introduces a threshold adaptive gradient compression (TAGC) algorithm, which can reduce redundant communication rounds and accelerate model convergence by appropriately increasing local computation. Second, we propose an adaptive weight adjustment mechanism (AWAM), which employs a staleness-based decay function and, based on varying data distributions, sets different weight coefficients to mitigate the impact of statistical and system heterogeneity. To tackle edge dynamics, a dynamic node selection algorithm based on deep reinforcement learning (DRL) is proposed. This algorithm enables adaptive adjustment of the number of local models participating in global model aggregation according to environmental changes. Finally, we analyze the convergence bound of CSFL theoretically and conduct extensive experiments on classical datasets to demonstrate the effectiveness of our algorithm. Compared with baseline algorithms, the experimental results indicate that CSFL can effectively decrease bandwidth resource consumption and total training time during the training of edge intelligence models across various datasets and data distributions.
Hybrid Distributed Learning With Knowledge Distillation for Resource-Efficient Intrusion Detection in Distributed Networks
The rapid evolution of telecommunications has increased network complexity and driven a shift toward decentralized architectures. While this shift introduces new landscapes and opportunities, it also enlarges the attack surface, highlighting the need for adaptive and scalable network security. In this context, artificial intelligence-based network intrusion detection systems (AI-NIDSs) have been extensively investigated to counter the increasing scale and complexity of network threats. Recently, to enable network threat detection in distributed environments, decentralized learning approaches such as federated learning (FL) and split learning (SL) have been actively explored. However, existing approaches impose substantial computational burdens on resource-constrained nodes and manifest inefficiencies in the learning process, which can lead to unstable convergence and noticeable performance degradation. In this article, we propose a novel AI-driven distributed NIDS that considers the computing capabilities of resource-constrained nodes while enabling efficient learning in distributed environments. To address the above challenges, we leverage the split-FL framework and incorporate a knowledge distillation (KD) strategy, with consideration for the objectives of proactive real-time intrusion detection at the network edge. Experiments on a 5G network dataset and an Open RAN dataset demonstrate that the proposed framework can achieve accuracy comparable to a centralized model while reducing local computational overhead and maintaining stable convergence under realistic data distribution scenarios.
Twin2Twin: Digital Twin–Driven Orchestration of Federated Learning in Medical IoT Environments
Sixth-generation (6G) networks are expected to integrate intelligence as a native capability, enabling advanced verticals such as digital health (eHealth) supported by large-scale Internet of Medical Things (IoMT) deployments. In this context, Federated Learning (FL) is emerging as a promising paradigm for collaborative model training, allowing distributed medical devices to learn from data while preserving privacy. Nevertheless, conventional approaches such as Federated Averaging (FedAvg) often suffer from unstable convergence and performance degradation in non-independent and non-identically distributed (non-IID) environments, especially under partial and resource-constrained client participation. To address these challenges, we propose a Digital Twin (DT)-enabled FL framework in which the server evolves from a passive aggregator into an active orchestrator of the learning process. The DT consists of a virtual representation of participating devices and their learning dynamics, thereby enabling an informed selection of clients and coordinated updates based on both resource conditions and predictive uncertainty. Building on this orchestration layer, we introduce Twin2Twin (T2T), a hierarchical aggregation strategy that groups clients into similarity-based cohorts and combines their updates in a structured manner, improving training stability in dynamic environments. Specifically, the proposed framework integrates: (i) DT-driven client orchestration that accounts for both device heterogeneity and data informativeness, and (ii) a similarity-aware aggregation mechanism that reduces update variability across training rounds. Experimental results demonstrate that the proposed strategy achieves faster and more stable convergence compared to traditional FL, highlighting the potential of DT-driven orchestration to support reliable and scalable learning in IoMT systems deployed in 6G networks.
HBA: Hijacking-Based Backdoor Attack for Vertical Federated Learning
Vertical federated learning (VFL) is a distributed machine learning paradigm designed for scenarios with vertically partitioned data features, making it highly compatible with Internet of Things (IoT) ecosystems. While promoting collaborative modeling among IoT devices, VFL also introduces new security risks, particularly backdoor attacks. Existing VFL backdoor attacks typically establish associations between triggers and target labels during the training phase by manipulating intermediate model outputs, making them easily detectable by advanced defense mechanisms. This article proposes a hijacking-based backdoor attack (HBA), which, for the first time, innovatively achieves a backdoor attack by exchanging the forward embeddings during the VFL prediction phase, without embedding traditional triggers. HBA leverages intrinsic semantic relationships in the embedding space to hijack the decision-making process of the top model during inference. HBA’s effectiveness depends on the discriminative nature of the features extracted by the bottom model, and since it does not alter the training process, it can evade most defense mechanisms based on training behavior monitoring. Experiments demonstrate that HBA achieves an attack success rate of 99.9% in classification tasks without compromising the original task’s accuracy. Furthermore, existing defense mechanisms struggle to effectively counter HBA without degrading the model’s original task performance.
RCFL: Recursive Clustered Federated Learning for Distributed Concept Drift
FedJoint: A software architecture for adaptive orchestration in federated learning systems
Privacy-Preserving Federated Multimodal Learning for Healthcare Applications
From tech blogs
See all →Looking beyond natural sequences
A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.
Generating scenarios for extreme events, without extreme data
A new algorithm learns to anticipate the unprecedented scenarios that critical infrastructure and global supply chains are least prepared for.
When AI art has no author: Study finds generated images often can’t be traced to training data
A new method for surgically removing training examples from a model reveals that as datasets grow, the link between what a model learns and what it produces dissolves.
What We Learned by Reproducing 2,200 papers from ICML
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Alexander Rakhlin named director of the MIT Statistics and Data Science Center
An expert in machine learning, statistics, and computation, Rakhlin succeeds Professor Ankur Moitra.
Towards a quantum computer that learns from its errors
Machine Intelligence