Qin-Yang Xu

Stored in Optimizer State, Valued by Later Training: A Causal Account of Subliminal Trait Transfer

Subliminal trait transfer allows a student model to acquire behavioral dispositions from teacher-generated data in which the trait is not semantically expressed. Recent work explains how such signals enter gradients, but not how they survive source removal or acquire different signs under later training. We treat param...