Scaling model-generated data is usually viewed as improving distillation: more examples should increase coverage, reduce noise, and produce stronger students. We show a second effect: larger datasets can make subtle teacher-specific signals easier to detect in the trained student, even when examples are off-task and ne...
Zhichen Dong, Zhi-Xuan Liu, Yuanjiu Fan, et al.· 1 citation
Trait-direction drift is proposed and validated as a mechanism for subliminal learning: biased generation creates measurable preference gaps in teacher data, and student-recognizable gaps induce trait-aligned updates during supervised fine-tuning that accumulate into behavioral transfer.
Zhi-Xuan Liu, Zhichen Dong, Yuanjiu Fan, et al.· 0 citations
A semantic-entropy-based method, using task uncertainty to guide prompt optimization, which requires no training, works with black-box models, and integrates easily into existing prompt optimizers.
Shuyang Zhang, Zhixuan Liu, Zhichen Dong et al.· Annual Meeting of the Associ...· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.