Preprint
Oct 2026
SliMOO: Interpretable Multi-Objective Evolutionary Search for LLM Depth Pruning
As large language models (LLMs) grow more powerful, their scale makes them costly to serve. Depth pruning offers a practical route to efficiency by directly reducing memory and latency without hardware-specific support. However, we observe that transformer layers exhibit markedly different task-dependent layer contribu...
Guan-Chen Li, Yi-Xing Xu, Xuan-Wu Yin et al.
· 0 citations