Skip to content

Author

Yongxin Li

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

Pre-carved Niches: The Formation Dynamics of Modular Task Partitions in Early LLM Training

This work tracks formation step by step of a Pythia-410M model from scratch and runs attribution patching at every step, alongside probes for gradient norms, effective updates, weight norms, and first-order loss decomposition across 14 tasks in four cognitive domains, confirming the hypothesis that modularity tracks learning.

Guang-Qi Li, Yongxin Li · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.