Skip to content
Conference

Data-Aware Optimization for Dual-Frozen ViT Distillation in Unsupervised Anomaly Detection*

Aug 2026 · 2026 IEEE 22nd International Conference on Automation Science and Engineering (CASE) · pp. 1065-1070 · 0 citations · 22 references

Abstract

Teacher-student distillation based on normal samples has been widely adopted in Unsupervised Anomaly Detection (UAD). Incorporating Vision Transformers (ViTs) into this task enhances global representation capability; however, existing methods still suffer from feature instability caused by pseudo-activation phenomena and the high optimization cost of full-parameter fine-tuning. To address these issues, this paper proposes a Dual-Frozen ViT Distillation (DFVD) framework, which freezes both teacher and student backbones. The teacher branch introduces a test-time register mechanism to suppress pseudo-activations and provide stable targets, while the student branch integrates learnable prompt tokens and lightweight adapters for feature alignment. By optimizing only lightweight modules, the framework enables parameter-efficient adaptation while preserving the representation capability of pretrained ViTs. Experiments on the MVTec AD benchmark demonstrate the effectiveness of the proposed method for anomaly detection and localization.

View source

Similar papers

Conference Open access 2026

Adaptive Loss Weighting for Unsupervised Industrial Anomaly Detection via Reverse Distillation

Due to the use of fixed loss weight allocation between different feature layers, unsupervised industrial surface anomaly detection often fails to capture multi-scale anomalies, resulting in the loss of fine-grained defects and severe background noise. To address this research gap, this paper proposes an unsupervised an...

Zhi-Xing Wu · 0 citations
2026

Memory-Augmented Reverse Distillation for Continuous Spectrum Anomaly Detection

Effective spectrum anomaly detection (SAD) is of paramount importance for maintaining communication security and spectrum utilization efficiency. Most existing research still focuses on training dedicated anomaly detection models for specific electromagnetic scenarios. However, developing such environment-specific SAD...

Tao Zhang, Rui-Wei Zhang, Zhi-Qiang Xiao et al. · 0 citations
Open access 2026

ShufflePaste: Four-Way Structural Disturbance Learning With Swin Transformer for Industrial Anomaly Detection

Industrial anomaly detection aims to identify defective samples that deviate from normal visual patterns, while real anomaly annotations are often scarce, costly, and incomplete in practical manufacturing scenarios. To address this challenge, this paper proposes ShufflePaste, a self-supervised representation learning f...

Yue-Zhou Wu, Wen-An Zhang, Qiang Fu et al. · 0 citations
Preprint Oct 2026

CORE: Contrast-and-Reflect for Self-Supervised Prompt Optimization in Anomaly Synthesis

Industrial anomaly detection (AD) is bottlenecked by the scarcity of anomalous samples, making high-fidelity anomaly synthesis crucial for improving downstream performance. However, existing methods either rely on scarce real anomaly references or auxiliary data, while lacking complex reasoning and iterative optimizati...

Hao-Xiang Rao, Fang Zhao, Zhao Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.