Skip to content

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#small language model Preprint Oct 2026

Massive Activation Gating Channel in Large Language Models

This paper finds that the emergence of massive activations is controlled by a single channel in the input embedding to a spike feed-forward network (FFN), and names this channel the massive activation gating channel (MAGC).

Min-Jia Mao, Shi Chen, Bo-Wen Yin et al. · 0 citations

Defending Against Malicious Finetuning by Scaling Train-time Adversarial Attacks

Patcher is a novel and efficient adversarial training algorithm that alternates between an attack stage and a defense stage: the attack stage simulates many-step malicious finetuning and computes the resulting parameter displacement as an"attack vector", while the defense stage aims to preserve safe behavior under such...

Hao-Min Wen, Shi Chen, Qingyu Shi et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.