Skip to content

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

Optimizer-dependent training dynamics converge to the same one-third optimal data scaling

Neural scaling, in which loss falls as a power law with training, is central to large language models, and one recent proposal is that a $1/3$ exponent emerges from learning peaked distributions. That account describes SGD, but models in practice are trained with adaptive optimizers. Here we separate two exponents the...

Hyunseok Lee, M. Basil, Yizhou Liu et al. · 0 citations
#machine learning Preprint Sep 2026

Emergent phases of superposition: from partial to full representation

This work shows that increasing the width drives a continuous phase transition from a partial-representation phase, where only a subset of features receives appreciable representation vectors while the rest vanish, to a full-representation phase, where every feature is represented.

Li-Hao Guo, Yizhou Liu, Jeff Gore · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.