This work proposes a novel domain-adaptive dual-gating MoE framework for SDD under unseen attack types and acoustic conditions that significantly outperforms the baseline and demonstrates superior generalization capabilities and efficient design.
Abstract
Recent advances in speech deepfake detection (SDD) have leveraged the Mixture of Experts (MoE) to enhance generalization capacity. However, existing gating networks often overlook the acoustic and temporal cues of deepfakes. In this work, we propose a novel domain-adaptive dual-gating MoE (DADGMoE) framework for SDD under unseen attack types and acoustic conditions. Our innovative dual-gating mechanism leverages Sinc-layer-based filters to process both low-level acoustic signals (raw waveforms) and high-level speech representations from a large self-supervised learning (SSL) model. It further incorporates domain prototypes to guide expert routing based on implicit deepfake patterns. The lightweight affine experts process the routed inputs. Experiments show that our DADGMoE significantly outperforms the baseline, achieving up to a 40.8% relative EER reduction on challenging out-of-dataset benchmarks. This framework demonstrates superior generalization capabilities and efficient design.
A novel E-Branchformer-based architecture that effectively leverages self-supervised speech representations for audio deepfake detection and employs parallel branches to simultaneously capture global contextual dependencies through multi-head self-attention and local temporal patterns through convolutional processing.
Phuong Dat, Học Thủ, T. Nguyễn et al.· 0 citations
CRAF, a cross-view residual-aware fusion framework that uses ALLM-guided cross-view attention to enrich SSL representations and adopts ALLM as a high-level reference to separate ALLM-explainable information from complementary SSL residual information, demonstrates robustness to unseen spoofing attacks.
M. Phan, Khalid Zaman, C. Mawalim et al.· arXiv.org· 0 citations
Advances in speech synthesis have made deepfake speeches increasingly convincing, posing growing threats to security. While self-supervised learning (SSL) based detectors achieve state-of-the-art performance, their computational demands (typically 300M+ parameters) prevent deployment on resource-constrained devices. Ex...
Miao He, Peng Cheng, Zhong-Jie Ba et al.· Interspeech· 0 citations
This paper proposes the Global-Local Adaptive Detector (GLAD), a Hierarchical Global-Local backbone that explicitly bridges the granularity gap by fusing global linguistic and acoustic features with fine-grained local signal details and introduces SaniBoost, a composite data augmentation strategy for robust signal stan...
Ze-Lin Zhao, Guan-Jie Huang, D. H. K. Tsang et al.· arXiv.org· 0 citations
The proposed Real-Anchored Mechanism-Incremental (RAMI) protocol reflects the practical setting in which available real speech provides a recurring mixed-domain reference while new deepfake mechanisms arrive incrementally and RF-Prompt, an asymmetric continual prompt-learning method that preserves reusable real-speech...
Yuan-Kun Xie, Xiao-Xuan Guo, Xiao-Peng Wang et al.· arXiv.org· 0 citations
The results indicate that multi-domain feature fusion offers a practical and generalizable solution for real-world deepfake audio detection, particularly in environments involving diverse codecs and synthesis techniques.
Akshat Chhatriwala, Ishita Akolkar, Namrata Shroff et al.· ITEGAM- Journal of Engineeri...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.