Residual Sparsification via Output Importance for Compressing Mixture-of-Experts LLMs
PARSER is a new residual sparsification method that shifts the compression objective from minimizing isolated matrix errors to preserving the expert output error, and achieves this by introducing output importance, which measures the actual contribution to the expert output error.