Lifelong learning enables intelligent systems to acquire knowledge incrementally while preserving previously learned information—a hallmark of human cognition. However, most Spiking Neural Network (SNN) models lack the critical biological mechanisms that support this capacity, particularly sparse circuit reconfiguratio...
Jiang-Rong Shen, Li-Ming Ye, Yu-Qi Yang et al.· Proceedings of the 34th ACM...· 0 citations
Sparse structural learning is crucial for deploying Spiking Neural Networks (SNNs) on resource-constrained neuromorphic hardware. However, most existing sparse structural learning methods for SNNs, largely inherited from Artificial Neural Networks (ANNs), focus on static magnitude to reduce parameters while overlooking...
Jun-Xiang Zhang, Jiang-Rong Shen, Hui-Yan Xue et al.· Proceedings of the 34th ACM...· 0 citations
The increasing scale of spiking neural networks (SNNs) poses significant challenges for deployment on resource-constrained neuromorphic hardware, necessitating lightweight and learnable structural solutions. Interestingly, biological neural systems employ an efficient organizational strategy—hierarchical structural reo...
Jiang-Rong Shen, Shu-Xian Dong, Qi Xu et al.· Proceedings of the 34th ACM...· 0 citations
Lifelong learning enables intelligent systems to acquire knowledge incrementally while preserving previously learned information—a hallmark of human cognition. However, most Spiking Neural Network (SNN) models lack the critical biological mechanisms that support this capacity, particularly sparse circuit reconfiguratio...
Jiang-Rong Shen, Li-Ming Ye, Yu-Qi Yang et al.· 0 citations
This work proposes two simplified attention mechanisms, Simplified Spiking Attention (SSA) and Ultra-Simplified Spiking Attention (USSA), which replace matrix multiplication with Hadamard products and eliminate hardware-unfriendly components such as multi-head attention and scaling.
Ting-Ting Jiang, Jiangrong Shen, Long Chen et al.· 1 citation· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.