Skip to content

FedHiPL: Federated Hierarchical Prototype Learning for Heterogeneous Non-IID Data

Sep 2026 · IEEE Internet of Things Journal · Vol 13, pp. 40931-40944 · 0 citations · 39 references
Computer Science

Abstract

Federated learning (FL) collaboratively trains models across networked industrial Internet of Things (IIoT) terminals. However, statistical heterogeneity in IIoT data often hinders the performance of global models. Current FL methods typically focus on single-level representation alignment and fail to exploit gradient-guided semantic feedback across hierarchical layers. To address statistical heterogeneity, we propose federated hierarchical prototype learning (FedHiPL), which models local representations with Gaussian prototypes and improves global learning through hierarchical prototype calibration. First, FedHiPL performs multilevel prototype alignment based on symmetric Kullback–Leibler divergence to enforce representation consistency across layers. Second, FedHiPL calibrates the local decision head by balancing local and global decision objectives with decision consistency constraints. Third, FedHiPL rectifies global prototypes through a gradient-guided hierarchical calibration module to maintain structural consistency across network layers. Experiments on a custom-constructed distributed cluster demonstrate that FedHiPL achieves 93.24% accuracy on Edge-IIoT and 72.36% accuracy on UNSW-NB15 under strong statistical heterogeneity, outperforming the representative prototype-based baseline FedProto by 6.06% and 15.80%, respectively.

View source

Similar papers

Conference Aug 2026

FedLEAF: Bi-directional Prototype Adaptation for Heterogeneous Federated Learning

Prototype-based knowledge sharing effectively mitigates data and model heterogeneity in federated learning (FL) by exchanging class-level semantic information. However, existing methods typically assume all local prototypes are equally reliable. Consequently, low-quality prototypes from heterogeneous models or dynamic...

Zhi-Yuan Zhu, Si-Yi Deng, Da-Peng Wu et al. · 0 citations
Jul 2026

FedTopo: Relation-Level Topology Sharing for Model-Heterogeneous Federated Learning

FedTopo is proposed, a relation-level framework that encodes global knowledge as class relation topology, capturing how classes relate within each client rather than where they lie in feature space.

Zhaoyang Ma, Zhihao Wu, Xin Gao et al. · 0 citations
Aug 2026

Prototype-based federated learning for one-time soft clustering

Experiments under representative Non-IID settings on benchmark datasets show that PFLS-One achieves improved accuracy and faster convergence compared with representative baseline methods, and the convergence analysis under a non-convex objective provides theoretical support for the proposed method.

Ping Xie, Xiang-Rui Gao, Jingyan Wu et al. · 0 citations
2025

FedLPA: Local Prior Alignment for Heterogeneous Federated Generalized Category Discovery

Local Prior Alignment (LPA) is introduced, a self-distillation mechanism that aligns batch-level predictions with empirical class prior derived from concept assignments that achieves robust generalized category discovery under severe data heterogeneity.

Geeho Kim, Jinu Lee, Bohyung Han · 1 citation
Open access Aug 2026

FedA2L: Adaptive layer-wise learning rate adjustment in decentralized federated learning

FedA2L is introduced, a method that dynamically adjusts layer-wise LRs based on model divergence signals that achieves up to 4.94 times faster convergence than vanilla DFL and reduces communication rounds by up to 59% compared to scheduler-based baselines.

V. T. Vo, K. Nguyen, Taehong Kim · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 7, 2026

Discovering the value of humanistic inquiry

Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.