Jul 2026
PALS: Percentile-Aware Layerwise Sparsity for LLM Pruning
PALS (Percentile-Aware Layerwise Sparsity), which adjusts per-layer sparsity based on the 99th percentile of activation magnitudes, bounded to $\pm 5\%$ around the target ratio, is proposed.
Yazdan Jamshidi, Alexey A. Shvets
· arXiv.org · 0 citations