Skip to content

Author

I. Loshchilov

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Aug 2026

Training nGPT

A practical training recipe for the normalized Transformer and its evaluation on modern hybrid Mamba-2--Transformer Mixture-of-Experts models shows that the 30B-total-parameter nGPT model reaches the same validation loss using approximately half as many training tokens.

I. Loshchilov, Boris Ginsburg · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.