JustQuant: You Don't Need Smoothing, SVD, or Rotation for 4-Bit Activation Quantization
JustQuant is proposed, a simple yet effective framework that moves the complexity of low-bit quantization from deployment-time operators into the training process and introduces Theseus QAD, a quantization-aware distillation method that progressively applies multi-level supervision, analogous to the gradual replacement...