Generalization Analysis for Adversarial Vision Transformers
This work establishes a high-probability generalization bound for ViTs in classification tasks under adversarial settings, and elucidates the roles of several factors in mitigating perturbation effects, norm regularization of weight matrices and depth-wise propagation constraints on layer-wise norms.
Ziwen Jiang, Chang Cao, Han Li et al.
· 0 citations