A Gradient-Calibrated Adversarial Prompt Optimization Framework for Large Language Model Safety Evaluation
Large language models (LLMs) may still produce unsafe responses under optimized adversarial prompts, even after safety alignment. Existing gradient-based jailbreak evaluation methods usually use raw gradient signals for discrete prompt search, but raw gradients may be unstable in both magnitude and direction. This pape...