When Isaac Newton discovered the law of gravitation, he did so through an iterative process of analyzing observed data such as planetary patterns, finding the underlying mechanisms by describing patterns in mathematical equations, and refining his theory against the Moon's orbit, revealing the startling insight that th...
Jia-Yi Geng, Zhengxuan Wu, Kevin S. Chen et al.· 0 citations
This suite provides a new efficient lens on generalization: select intermediate pre-training checkpoints that strongly generalize reasoning and alignment, better than the final pre- or mid-training checkpoints, and select pre-training data that controls and stabilizes generalization dynamics.
Jia-Xin Wen, Zhengxuan Wu, D. Song et al.· 0 citations
This work introduces PRISM Edit, which optimizes a single polysemous representation across temporal contexts and leverages the model's inherent modulation pathway to route it to temporally correct predictions without requiring any architectural modification.