Aug 2026· 2026 IEEE 22nd International Conference on Automation Science and Engineering (CASE)· pp. 1065-1070· 0 citations· 22 references
Abstract
Teacher-student distillation based on normal samples has been widely adopted in Unsupervised Anomaly Detection (UAD). Incorporating Vision Transformers (ViTs) into this task enhances global representation capability; however, existing methods still suffer from feature instability caused by pseudo-activation phenomena and the high optimization cost of full-parameter fine-tuning. To address these issues, this paper proposes a Dual-Frozen ViT Distillation (DFVD) framework, which freezes both teacher and student backbones. The teacher branch introduces a test-time register mechanism to suppress pseudo-activations and provide stable targets, while the student branch integrates learnable prompt tokens and lightweight adapters for feature alignment. By optimizing only lightweight modules, the framework enables parameter-efficient adaptation while preserving the representation capability of pretrained ViTs. Experiments on the MVTec AD benchmark demonstrate the effectiveness of the proposed method for anomaly detection and localization.
Due to the use of fixed loss weight allocation between different feature layers, unsupervised industrial surface anomaly detection often fails to capture multi-scale anomalies, resulting in the loss of fine-grained defects and severe background noise. To address this research gap, this paper proposes an unsupervised an...
Effective spectrum anomaly detection (SAD) is of paramount importance for maintaining communication security and spectrum utilization efficiency. Most existing research still focuses on training dedicated anomaly detection models for specific electromagnetic scenarios. However, developing such environment-specific SAD...
Tao Zhang, Rui-Wei Zhang, Zhi-Qiang Xiao et al.· IEEE Transactions on Cogniti...· 0 citations
Industrial anomaly detection aims to identify defective samples that deviate from normal visual patterns, while real anomaly annotations are often scarce, costly, and incomplete in practical manufacturing scenarios. To address this challenge, this paper proposes ShufflePaste, a self-supervised representation learning f...
Yue-Zhou Wu, Wen-An Zhang, Qiang Fu et al.· IEEE Access· 0 citations
Industrial anomaly detection (AD) is bottlenecked by the scarcity of anomalous samples, making high-fidelity anomaly synthesis crucial for improving downstream performance. However, existing methods either rely on scarce real anomaly references or auxiliary data, while lacking complex reasoning and iterative optimizati...
Hao-Xiang Rao, Fang Zhao, Zhao Wang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.