Skip to content

Author

Ke Chen

We have 1 of 2 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Output-aware Residual Stream Pruning for Large Language Models

This work characterize the effect of a residual-stream perturbation through both its activation covariance and the local sensitivity of the model output, and derives a tractable spectral upper bound that reduces subspace selection to an eigendecomposition of a sensitivity-weighted covariance matrix, retaining the effic...

Chayne Thrash, Ke Chen, Soheil Kolouri · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.