Preprint
Oct 2026
Integer-Exact Microscaling: Running MXFP4 Language Models on INT8 Matrix Units
This work shows when no per-block work is needed: a row of MXFP4 weights is exactly one INT8 vector times one power-of-two scale if its block exponents span at most three, so a linear layer becomes a single INT8 GEMM with one rescale per output.
Shinyoung Kang, Junhyung Ahn, Yujun Kim et al.
· 0 citations