Transfer Safety Awareness for Cross-Modal Safety Drift in Multimodal Large Language Models
Motivated by the observation that safety signals from unsafe text processing can be transferred, safety-awareness representation transfer (SRT) is proposed, a lightweight direction-refinement method that mitigates cross-modal safety drift with a frozen MLLM backbone.
Tian-Qi Xiao, Shiyao Cui, Ming-Hao Zhang et al.
· 0 citations