Towards Full Pipeline FP8 Reinforcement Learning for LLMs
Reinforcement learning (RL) has become a key technique for improving the reasoning and agentic abilities of large language models (LLMs). Although FP8 quantization can accelerate RL training, maintaining stability throughout an FP8 RL pipeline remains challenging. While previous works have focused on resolving train-in...
Fan Chen, Ziheng Jiang, Zi-Yun Wei et al.
· 0 citations