Which Neurons Detect Malicious Code? A Probing Study of LLM Security Knowledge
Probing the neurons associated with security-relevant knowledge helps to gain insights into how LLMs encode malicious programming concepts, identify potentially harmful memorized behaviors, and pave the way toward more reliable defense mechanisms, such as neuron-level editing, selective unlearning, and security-aware a...