Skip to content

Author

Hao Wang

We have 3 of 20 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Jul 2026

Interpretable GOHR Agents via Sparse Autoencoders

This work reports interpretability experiments for a tokenized autoregressive Transformer agent in the Game of Hidden Rules (GOHR), a compact two-rule task in which both hidden rules map object shapes to target buckets, but with different permutations.

Shiwei Tan, Yu-Song Zhao, Weiyi Qin et al. · 0 citations
Jul 2026

Cross-Tokenizer On-Policy Distillation via Byte-Prefix Marginalization

Open-weight language models from different families exhibit complementary capabilities, motivating their consolidation into a compact student through on-policy distillation (OPD). However, full-vocabulary OPD typically assumes a shared tokenizer, while existing cross-tokenizer methods may discard teacher probability ma...

Hao Wang, Kun Yuan, Wenlin Zhong et al. · 5 citations · ⚡1
Preprint Aug 2026

AsymSpec: Context-Asymmetric Speculative Decoding for Agentic LLMs

AsymSpec, an asymmetric speculative decoding framework that breaks this symmetry: a lightweight drafter reads the full input while the large verifier operates on the compressed view, is proposed, showing that asymmetric context access yields substantial gains precisely when compression discards critical reasoning signa...

Sheng Liang, Yong-Yue Zhang, Nathanael Brian et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.