Skip to content

Author

Heng-Yi Wang

3 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#natural language process... Preprint Sep 2026

Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning

Random Attention keeps the prompt and evicts uniformly at random within each attention head, computing no score at all; across four models and six reasoning tasks, it matches the strongest baseline in task performance while delivering 32-43% higher throughput than that method when deployed with vLLM.

Heng-Yi Wang, Jie-Lin Qiu, Wenting Zhao et al. · 0 citations
Preprint Aug 2026

AI4AI at Test-Time: Strong-to-Weak Capability Transfer via Harnesses

It is suggested that inference-time harness design is an important complement to conventional training-time distillation, enabling strong models to transfer cognitive structure to weaker models without retraining.

Cheng Qian, Wenting Zhao, Liang-Wei Yang et al. · 5 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.