Graphics Processing Units (GPUs) accelerate many modern computationally intensive workloads, and achieving high performance on them depends heavily on sophisticated GPU compiler optimizations. However, even small changes in GPU compiler optimization heuristics or code-generation decisions can silently introduce severe...
Wai-Kin Wong, Dong-Wei Xiao, Ping Ke et al.· Proceedings of the 32nd ACM...· 0 citations
Online LLM serving is increasingly constrained by GPU memory capacity during decode. In length-skewed workloads, a small fraction of long requests keeps large key-value (KV) caches resident across many decode steps, exhausting GPU high-bandwidth memory (HBM), throttling admission, and reducing goodput for the short-req...
Dong Chen, Yu-Kun Zhou, Sheng Yao et al.· Proceedings of the 2026 ACM...· 0 citations
Reasoning traces generated by large language models (LLMs) provide interpretability by exposing the factors that purportedly support their predictions. Such interpretability is important because model decisions may rely on spurious factors, and it can help practitioners identify such reliance and respond appropriately....
Jia-Lai Wang, Jun-Chen Lu, Song-Tao Yang et al.· Proceedings of the 41st IEEE...· 0 citations
Large language models (LLMs) exhibit impressive capabilities but are susceptible to adversarial attacks that induce harmful outputs. Although various defenses have been proposed, their practicality is restricted by substantial runtime overhead or degraded model helpfulness. Moreover, LLM applications typically have div...
Zhenlan Ji, Dao-Yuan Wu, Wen-Xuan Wang et al.· Proceedings of the ACM on So...· 0 citations
The StateLens framework is presented, a framework that employs Large Language Models (LLM) to automate the discovery of deep internal states and significantly outperforms state-of-the-art fuzzers and uncovers 68 new bugs.
Wai-Kin Wong, Dong-Wei Xiao, Anthony Cheuk Tung Lai et al.· Proceedings of the ACM SIGOP...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.