LLM post-training combines supervised fine-tuning (SFT), a mode-covering forward-KL objective, with reinforcement learning (RL), a mode-seeking reverse-KL objective, with reinforcement learning (RL), a mode-seeking reverse-KL objective to exploit anisotropy, a division of labor that post-training can exploit.
Samyak Jha, Harshvardhan Saini, Yi-Zhen Liao et al.· 0 citations
Fixed-SAE Track is introduced, a framework that trains one shared SAE per considered layer on activations pooled across the base model and all RL checkpoints, holding every feature direction fixed so that representation shifts are rigorously defined through the activations of interpretable SAE latents, including the de...
Ling-Heng Du, Yi-Ming Tang, Xufeng Duan et al.· 1 citation
Capsule Lens is introduced, a framework that matches the region a concept occupies with a simple, trackable geometric form, a capsule, defined by several interpretable parameters, fitted in closed form to each concept's geometry and validated on held-out samples.
Yi-Ming Tang, Harshvardhan Saini, Samyak Jha et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.