SPHQuant: Efficient extreme low bit weight quantization for Vision-Language Models
SPHQuant is a rotation-free spherical weight-only quantization framework for VLMs that isolates outlier magnitude into the radius while keeping directions bounded and statistically regular and designs a hardware-friendly GEMV kernel that keeps the direction codebook small enough for shared-memory lookup and packs radial bits efficiently.
Ke-Wei Zhang, Zheng Chen, Hao-Tong Qin et al.
· 0 citations