Michael Mitzenmacher

TORQUE: Optimizing What (not) to Quantize Before and After Rotation

Uniform random rotations are an effective preprocessing step for quantization: they make normalized coordinate distributions approximately Gaussian, enabling the use of codebooks optimized offline. We introduce TORQUE, a framework that improves on previous quantization works that use random rotations by jointly optimiz...