Skip to content

Author

Haozheng Luo

Northwestern University

We have 4 of 36 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Attention Sinks and Outliers in Attention Residuals

OASIS is proposed, an outlier- and sink-aware method that stabilizes dual-normalized attention-residual architectures through explicit null routing and token-to-depth null coupling and offers insight into the low-bit sensitivity observed in AttnResidual.

Haozheng Luo, Hao-Ran Dai, Shao-Ling Zhang et al. · 2 citations
#artificial intelligence Preprint May 2026

Compute Allocation for Self-Evolving LLMs: From Depth-Breadth to Multi-Armed Bandits

BaSE (Bandit-based Self-Evolving), a multi-armed bandit that allocates LLM calls across parallel trajectories is proposed, a multi-armed bandit that improves mean fitness by 12.3% over the strongest island-protocol baseline across 8 (model, task) cells.

Si-Xue Xing, Hao-Yu He, Kerui Wu et al. · 4 citations
#machine learning Preprint Aug 2026

Learn What's Left, Not What's Mastered: Saturation Aware Advantage Reweighting for Multi-Reward Policy Optimization

Saturation Aware Advantage Reweighting for Multi-Reward Policy Optimization (SA-MRPO), which standardizes each reward objective independently and adaptively discounts its contribution according to a batch-level estimate of objective saturation, and dynamically reallocates optimization effort toward under-optimized obje...

Yi-Xuan Wang, Yi-Fei Chen, Haichao Zhang et al. · 3 citations · ⚡1

Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents

This work presents Memory as a Controlled Process (MemCon), a framework that models memory operations as a Markov Decision Process and learns an online policy that adaptively decides when, what, and how much to retrieve, when to inject a distilled plan, and when to consolidate or forget.

Eric Jiang, Zhi Zhang, Yuchen Wu et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.