Open access
Jul 2026
Activation Steering for Enhancing Mathematical Reasoning in Large Language Models: A Study of Cross-Model Generalization
An activation steering method based on single-vector ablation is proposed to enhance mathematical reasoning by injecting a carefully constructed steering vector into the model’s residual stream by constructing the AS direction from the activation difference between mathematical and general-domain samples.
Yuyang Han, Panpan Zhang, Bo Zhang
· Advances in Engineering Tech... · 0 citations