Dual-grained Internal Refusal Estimation (DIRE), a training-free detection framework that jointly probes resilient Attention routing and FFN semantic memory within effective semantic layers to detect multimodal jailbreaks in a training-free manner, is introduced.
Xi-Yu Zeng, Li-Ming Lu, Xu Zheng et al.· 0 citations
As the capabilities of Vision Language Models (VLMs) continue to improve, they are increasingly targeted by jailbreak attacks. Existing defense methods face two major limitations: (1) they struggle to ensure safety without compromising the model’s utility; and (2) many defense mechanisms significantly reduce the model’...
Shu-Chao Pang, Xiyu Zeng, Si-Yuan Liang et al.· IEEE Transactions on Informa...· 6 citations
SafeSteer is a lightweight, inference-time steering framework that effectively defends against diverse jailbreak attacks without modifying model weights, using the innovative use of Singular Value Decomposition to construct a low-dimensional safety subspace during inference.
Xiyu Zeng, Siyuan Liang, Liming Lu et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.