Aug 2026· Electronics· Vol 15, pp. 3481· 0 citations· 36 references
TL;DR
A granularity-centered taxonomy is introduced that organizes PFL approaches according to the structural depth of personalization, ranging from head-layer and layer-wise adaptation to model-wise and parameter-wise customization.
Abstract
Personalized Federated Learning (PFL) has emerged as a key approach to address performance degradation in FL systems under heterogeneous client data. While existing surveys typically categorize PFL methods based on optimization strategies or system-level mechanisms, they often overlook a fundamental question: where is personalization embedded within the model architecture? In this survey, we bridge this knowledge gap and introduce a granularity-centered taxonomy that organizes PFL approaches according to the structural depth of personalization, ranging from head-layer and layer-wise adaptation to model-wise and parameter-wise customization. This novel perspective helps practitioners select appropriate personalization strategies based on model architecture, data heterogeneity, and system constraints. By analyzing representative works published between 2016 and 2026, we identify recurring design bottlenecks and highlight key opportunities for improving personalization across different granularity levels. While existing surveys focus solely on algorithms, our taxonomy provides practitioners and researchers with the informed guidance needed to design scalable and effective PFL systems. Building upon this analysis, we also formulate and discuss several unaddressed open challenges currently present in the field, highlighting specific roadblocks and unresolved questions that must be addressed to drive the future evolution of PFL methodologies.
Experimental results show that routing-aware collaboration consistently improves personalized performance compared to conventional federated averaging and local training, while maintaining the same communication cost, and shows that client-centric and expert-centric clustering provides an effective and scalable approac...
Ankita Sharma, B. Farahani, S. Moosavi et al.· Coins· 0 citations
FedTAR is proposed, a task-aware federated fine-tuning method for MoE-based LLMs that establishes the association between local updates and task preference via routing outputs and preserves expert specialization and mitigates destructive interference among heterogeneous clients.
Ting-Qi Wang, Hongyu Ke, Hao-Xin Wang et al.· 0 citations
FedPrism is proposed, a novel framework that shifts alignment granularity from the coarse client level to the precise instance level and devise a Posterior-Guided Performance Distillation mechanism that leverages experts' actual training loss as self-supervision to autonomously refine routing policies without explicit...
Ke Wang, Shao-Jing Fu, Yu-Chuan Luo et al.· Proceedings of the Thirty-Fi...· 0 citations
This work revisits hypernetworks and proposes a model heterogeneous personalized federated learning framework, MH-pFedHN, which quantifies clients with different architectures using customized embedding vectors and then generates client-specific model parameters through a server-side hypernetwork.
Chen Zhang, Husheng Li, Xiang Liu et al.· Proceedings of the Thirty-Fi...· 0 citations
FedGPA is proposed, a hierarchical framework in which clients with comparable resources and identical architectures form a group and a server mediates knowledge transfer across groups of diverse models, and at its core, the lightweight, model-agnostic Aligned Co-decision (Alco) Unit aligns class-level prototypical info...
Liyinglan Liu, Zikai Xiao, Zi-Han Chen et al.· Journal of Machine Learning...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.