Beyond Shadow Weights: Quantization-Aware Training as Quantized-Endpoint Descent
An idealized model for the residual phase is proposed, which records where each shadow weight sits inside its quantization cell as a fraction of the cell width as a fraction of the cell width, which leads to a crossing law that determines which coordinates cross quantization boundaries after a shadow update.