FedAD: adaptive federated disentanglement for domain generalization in unlabeled medical imaging
TL;DR
FedAD: Adaptive Federated Disentanglement is presented, a unique framework that uses two key ideas to handle problems in a synergistic way in terms of generalization to unseen target domains, and outperforms current approaches in terms of generalization to unseen target domains.
Abstract
Three barriers significantly hinder the use of deep learning in medical imaging: poor generalization to new clinical domain shifts, label scarcity, and data privacy. A unified framework that learns from unlabeled, decentralized data while optimizing for generalization is desperately needed, even if Federated Learning (FL), Self-Supervised Learning (SSL), and Domain Generalization (DG) provide partial solutions that often operate under contradictory assumptions. We present FedAD: Adaptive Federated Disentanglement, a unique framework that uses two key ideas to handle these problems in a synergistic way. First, a federated semantic disentanglement objective (FedSD) explicitly distinguishes between the domain-invariant semantic characteristics and domain-specific variants using a non-adversarial orthogonality constraint. Second, in order to prevent premature convergence and enhance resilience, an adaptive teacher-student alignment (ATSA) curriculum dynamically modifies the generalization pressure based on the stability of the global model. This dual technique creates a strong feature encoder by forcing the model to learn what it sees as opposed to where it sees it. FedAD outperforms current approaches in terms of generalization to unseen target domains, as demonstrated by its validation on publicly available medical datasets. Our strategy concurrently addresses privacy, label scarcity, and domain change, paving the road for useful, reliable, and fair medical AI.