Skip to content

Author

Morteza Mardani

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Oct 2026

Large Language Continuous Diffusion Models

Despite the success of discrete diffusion language models (dLMs) for fast parallel decoding, their non-smooth, high-dimensional space hinders trajectory steering for reasoning and inference acceleration. To overcome this, we present Sigma, the first large-scale (3B/8B) continuous dLM built on steerable, low-dimensional...

Zhi-Han Yang, Wei Guo, Jean-Marie Lemercier et al. · 0 citations

Continuous Diffusion Scales Competitively with Discrete Diffusion for Language

The first scaling law for continuous DLMs that rivals discrete DLMs is established: RePlaid exhibits a compute gap of only $20\times$ compared to autoregressive models, outperforms Duo while using fewer parameters, and outperforms MDLM in the over-trained regime.

Zhi-Han Yang, Wei Guo, Shuibai Zhang et al. · 12 citations · ⚡2

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.