Skip to content

CMP-LSTM: Accuracy-Driven Column-Wise Maximum Pruning for Efficient LSTM Acceleration

Nov 2026 · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · Vol 45, pp. 5853-5862 · 0 citations · 33 references

Abstract

Long short-term memory (LSTM) networks are widely used in sequence-based tasks such as speech recognition and sentiment analysis. However, the presence of gating units significantly increases computational overhead and memory usage, making LSTMs less suitable for resource-constrained edge devices and latency-sensitive applications. To address this, various model compression techniques, such as pruning and structured weight, have been explored to reduce memory access and computational demands. However, deploying these compressed models on conventional LSTM accelerators often suffers from low compute efficiency, limiting their practical applicability. This article proposes a novel column-wise pruning method that adaptively adjusts the sparsity of gating matrices based on their sensitivity to model accuracy, thereby maximizing overall sparsity (OS). To further reduce computational complexity, the sparse vectors processed using the delta network (DN) efficiently skip zero elements during matrix computations. Moreover, we introduce a highly optimized column-wise hardware architecture tailored for efficient LSTM inference. Our accelerator is implemented on an AMD Zynq 7000 XC7Z100 field-programmable gate array (FPGA) and evaluated using the TIMIT dataset. Experimental results demonstrate an <inline-formula> <tex-math notation="LaTeX">$80.5\times $ </tex-math></inline-formula> model compression rate without accuracy loss and 24.8 Top/s of effective throughput. Compared to state-of-the-art LSTM accelerators, our design achieves <inline-formula> <tex-math notation="LaTeX">$2.6\times \sim ~27\times $ </tex-math></inline-formula> speedup and <inline-formula> <tex-math notation="LaTeX">$2.3\times \sim ~25\times $ </tex-math></inline-formula> improvement in energy efficiency.

View source

Similar papers

#computer vision Review Sep 2017

Agile Software Development Methods: Review and Analysis

This publication proposes a definition and a classification of agile software development approaches and analyses ten software development methods that can be characterized as being "agile" against the defined criterion.

P. Abrahamsson, O. Salo, Jussi Ronkainen et al. · 727 citations · ⚡54
#computer vision Jun 2008

The impact of agile practices on communication in software development

The study shows that agile practices improve both informal and formal communication, but indicates that, in larger development situations involving multiple external stakeholders, a mismatch of adequate communication mechanisms can sometimes even hinder the communication.

M. Pikkarainen, Jukka Haikara, O. Salo et al. · 401 citations · ⚡48
#machine learning Review Open access Oct 2014

Software development in startup companies: A systematic mapping study

The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.

Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al. · 394 citations · ⚡54

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.