Skip to content

Author

Nima Tajbakhsh

We have 3 of 67 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

CSD: Common-Support Distillation for Cross-Tokenizer Knowledge Transfer

Cross-tokenizer logits distillation enables knowledge transfer across model families, allowing students to learn from stronger or more specialized teachers. However, differences in vocabulary and segmentation make teacher and student next-token distributions difficult to align. Existing logits-based methods are easy to...

Mingyu Yang, Sharath Turuvekere Sreenivas, Adithyakrishna Venkatesh Hanasoge et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Accelerating Video Diffusion via Training-Free Trajectory Routing

TRACK: TRajectory-Aware Capacity routing via top-K selection is presented, a heterogeneous denoising strategy that switches between compatible large and small models at selected steps, reducing the average cost per denoising evaluation.

Mustafa Munir, Huy Vu, Shreyas Misra et al. · 0 citations
Jul 2026

SOAP, Muon, and Beyond: Pushing LLM Pretraining Scales

This work adapt and enhance preconditioned gradient methods to overcome the practical challenges of large-scale LLM pretraining and proposes algorithmic modifications including per-step QR orthogonalization and improved preconditioning strategies to enable stable training in these regimes.

Mikail Khona, Aditya Vavre, Boxiang Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.