PrismQuant: Optimal Null-Space Rotations for Grouped Quantizers
Smaller activation outliers do not necessarily imply better low-bit quantization: their alignment with the quantizer matters. We introduce PrismQuant, a quantizer-aware rotation framework that aligns the leading activation eigenspace with the constant group subspace of asymmetric grouped INT4. The affine offsets repres...
Yan-Long Chen, Yi-Ning Chen, Song Zhang et al.
· 0 citations