#machine learning
Jul 2025
Squeeze10-LLM: Squeezing LLMs' Weights by 10 Times via a Staged Mixed-Precision Quantization Method
Squeeze10-LLM is a staged mixed-precision post-training quantization (PTQ) framework and achieves state-of-the-art performance for sub-2bit weight-only quantization, improving average accuracy from 43% to 56% on six zero-shot classification tasks--a significant boost over existing PTQ methods.
Qingcheng Zhu, Yang-Yang Ren, Lin-Lin Yang et al.
· arXiv.org · 1 citation