ADTGuard: Adaptive Depth-Time Safeguard for Streaming Inference in Large Language Models
ADTGuard consistently achieves strong streaming detection performance, matching or surpassing state-of-the-art safeguards while requiring only 16M trainable parameters and maintaining competitive per-token latency.
Chu Wei, Chu-Rui Yang, Zi-Han Zhang et al.
· 0 citations