We have 3 of 64 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
Uniform random rotations are an effective preprocessing step for quantization: they make normalized coordinate distributions approximately Gaussian, enabling the use of codebooks optimized offline. We introduce TORQUE, a framework that improves on previous quantization works that use random rotations by jointly optimiz...
PRED-MoE uses a lightweight predictor to assess which experts are most likely to be required for prefetching and ranks experts by their near-future activation likelihood for eviction, and indicates that it reduces the TPOT of vLLM and HuggingFace by up to 3.02× and 28.62× respectively.
The Entropy Constrained Adaptive Stochastic Quantization problem is formulated, which jointly selects adaptive quantization values to minimize MSE under an entropy budget and an unbiasedness constraint, and an iterative refinement procedure is provided for the approximation solution.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
