Author

Niclas Hertzberg

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Jan 2026

Output Embedding Centering for Stable LLM Pretraining

This paper proposes output embedding centering (OEC) as a new mitigation strategy, and demonstrates that it suppresses output logit divergence and finds that $\mu$-loss is significantly less sensitive to regularization hyperparameter tuning than z-loss.

Felix Stollenwerk, A. Lokrantz, Niclas Hertzberg · arXiv.org · 4 citations