Ioana Marinescu

Reason in Style: Discovering and Controlling Style in Language Models

An algorithm is designed that learns to separate representations of content and style from language models' outputs and validate its effectiveness on math questions in a controlled setting, finding that style affects correctness: the probability of solving a problem depends on the style the authors condition on, and di...