Skip to content

Author

Ngai Wong

We have 3 of 8 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#natural language process... Preprint Oct 2026

Prefilling-dLLM v2: Learned Chunk Routing for Long-Context Diffusion Language Models

Diffusion language models apply bidirectional attention over the whole context at every denoising step, so a longer context makes each step substantially more expensive. Sparsifying only at inference leaves the pretrained weights unchanged, so the model is never trained under the sparse pattern it runs with. We propose...

Qi Han, Jing Xiong, Zi-Yuan Zhang et al. · 0 citations
#machine learning Preprint Sep 2026

QuantMLA: Function-Aligned Dual-Path Quantization for Low-Bit MLA KV Caching

Multi-Head Latent Attention (MLA) enables expressive multi-head attention with compact caches for its content and decoupled RoPE paths, yet cache memory still scales linearly with context length and batch size. In this work, we establish a systematic model of MLA's dual-path quantization errors, characterizing their di...

Zun-Hai Su, Yuxuan Sun, Jian-Chao Tan et al. · 0 citations
#natural language process... Preprint Sep 2026

Efficient Reasoning Exploration via State-Conditioned Latent Steering with Progress Guidance

SPS is a training-free latent steering framework that constructs a state-conditioned Direction Bank containing multiple progress-guided steering vectors for different prefix-state regions and applies it at high-uncertainty transitions to guide the next reasoning step toward meaningful progress.

Hengyuan Zhang, Chenming Shang, Zun-Hai Su et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.