Skip to content

Author

Hongyuan Zhan

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Positional Encoding via Token-Aware Phase Attention

Token-Aware Phase Attention (TAPA) is introduced, a new positional encoding method that incorporates a learnable phase function into the attention mechanism and attains substantially lower perplexity and stronger retrieval performance in the long-context regime than RoPE-style baselines.

Yu Wang, Sheng Shen, Rémi Munos et al. · 2 citations

Large Reasoning Models Learn Better Alignment from Flawed Thinking

RECAP (Robust Safety Alignment via Counter-Aligned Prefilling), a principled reinforcement learning (RL) method for post-training that explicitly teaches models to override flawed reasoning trajectories and reroute to safe and helpful responses, substantially improves safety and jailbreak robustness, reduces overrefusa...

Sheng-Hsuan Peng, E. Smith, Ivan Evtimov et al. · 10 citations · ⚡2

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.