Skip to content

Author

M. Patwary

We have 4 of 65 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Review Oct 2026

Scaling Synthetic Pre-training Data and Evaluation for Indic LLMs

This work introduces Nemotron-Pretraining-Indic-v1, a synthetic pretraining corpus of approximately 2.83 trillion tokens covering all 22 scheduled Indian languages in native script and twelve in romanized form and introduces the Indic-LLM-Eval-Suite, a multilingual benchmark suite for evaluating Indic language models a...

Abhinav Khattar, Aishwarya Chhabra, A. Velingker et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Before They Can Solve: Predicting Post-Training Coding-Agent Performance from Base Models

How can we predict which base checkpoint is worth an expensive round of agentic post-training? End-to-end pass@$K$ tests whether successful behavior already appears in a base model's distribution, but it is a poor fit for agentic coding: many base checkpoints cannot reliably produce the well-formed tool invocation requ...

Tan Yu, A. Bukharin, Khushi Bhardwaj et al. · 1 citation
Jul 2026

SOAP, Muon, and Beyond: Pushing LLM Pretraining Scales

This work adapt and enhance preconditioned gradient methods to overcome the practical challenges of large-scale LLM pretraining and proposes algorithmic modifications including per-step QR orthogonalization and improved preconditioning strategies to enable stable training in these regimes.

Mikail Khona, Aditya Vavre, Boxiang Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.