An accelerator-friendly QP solver is implemented that accumulates one Hessian per weight matrix and solves many small QPs in parallel with a convergence certificate per column, enabling one-shot post-training pruning at scale on a single accelerator without fine-tuning.
Mohammad Mozaffari, Samuel Kushnir, Maryam Mehri Dehnavi et al.· arXiv.org· 2 citations
The study establishes a connection between the complexity of algorithmic sequences and the memorization capacity of neural architectures, revealing the trade-offs involving memorization quality, rollout stability, and computational expense.
Xin-Ye Chen, S. Güttel, Mohammad Mozaffari· 0 citations
Prohibitive computational and environmental costs impede the scalable deployment of Large Language Models (LLMs). Traditional compression techniques (sparsity, quantization, low-rank approximations) are typically applied in isolation, and each hits an accuracy-efficiency wall. This thesis proposes the"Compression Trini...
Mohammad Mozaffari· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.