2025· Neural Information Processing Systems· 1 citation· 44 references
Computer Science
TL;DR
This work proposes the use of ternary spike neurons, which enhance the information-carrying capacity in the spiking neural rendering model, and introduces Spik-NeRF (Spiking Neural Radi-ance Fields with Ternary Spike), which achieves rendering performance comparable to ANN-based NeRF models.
Abstract
Spiking Neural Networks (SNNs), as a biologically inspired neural network architecture, have garnered significant attention due to their exceptional energy efficiency and increasing potential for various applications. In this work, we extend the use of SNNs to neural rendering tasks and introduce Spik-NeRF (Spiking Neural Radi-ance Fields with Ternary Spike). We observe that the binary spike activation map of traditional SNNs lacks sufficient information capacity, leading to information loss and a subsequent decline in the performance of spiking neural rendering models. To address this limitation, we propose the use of ternary spike neurons, which enhance the information-carrying capacity in the spiking neural rendering model. With ternary spike neurons, Spik-NeRF achieves performance that is on par with, or nearly identical to, traditional ANN-based rendering models. Additionally, we present a re-parameterization technique for inference that allows Spik-NeRF with ternary spike neurons to retain the event-driven, multiplication-free advantages typical of binary spike neurons. Furthermore, to further boost the performance of Spik-NeRF, we employ a distillation method, using an ANN-based NeRF to guide the training of our Spik-NeRF model, which is more compatible with the our ternary neurons compared to the standard binary neurons and other neuron forms. We evaluate Spik-NeRF on both realistic and synthetic scenes, and the experimental results demonstrate that Spik-NeRF achieves rendering performance comparable to ANN-based NeRF models.
A Spiking Neural Network (SNN) is a kind of brain-inspired and event-driven network, which is becoming a promising energy-efficient alternative to Artificial Neural Networks (ANNs). In recent years, SNN methods have been successfully applied in the fields of electromagnetic signal processing and image signal processing, particularly in application scenarios that require low energy consumption. However, the performance of SNNs by direct training is far from satisfactory. In this paper, we study a novel learning method named SAD-SNN (Spatial-Activation Distillation for Spiking Neural Networks), which utilizes the ANN model to guide the SNN model learning. Unlike prior works that rely on element-wise feature alignment approaches, SAD-SNN aligns spatial-activation maps at different resolutions of the teacher and student networks. Specifically, we introduce a direct alignment approach, which defines a spatial-activation loss and normalizes the representation vectors of ANN and SNN, to alleviate the unexpected precision loss. This enables the knowledge of teacher ANNs to be effectively transferred to train student SNNs. On three image classification datasets, our proposed SAD-SNN outperforms other SNN training methods no matter whether homogeneous or heterogeneous teacher ANNs are used. Furthermore, we apply SAD-SNN to the electromagnetic signal detection task, demonstrating strong generalization ability and superior performance. In conclusion, the experimental results on various tasks and SNN architectures demonstrate that our method is a general and effective solution that significantly improves the learning of student SNNs with only two time steps.
Chongxiao Qu, Qian Zhang, Chenxiao Dou et al.· Italian National Conference...· 0 citations
Simulation results show that incorporating astrocytic modulation consistently enhances classification performance in leaky integrate-and-fire (LIF) networks, including under noisy conditions, and suggest that augmenting simplified astrocytic dynamics can improve robustness and computational capability in SNNs, while also increasing their biological plausibility.
D. Garcia, Sabir Jacquir· International Conference on...· 0 citations
This work proposes Burst Spiking Neural Networks (BuSNNs), built upon Burst-enhanced Spiking Neurons and a Dynamic Weight Constraint (DWC) mechanism, which mitigates perturbation-induced transitions in activation states and thereby enhances robustness.
Jiahong Zhang, Sijun Shen, Man Yao et al.· 0 citations
Spiking recurrent neural networks (SRNNs) rival gated recurrent neural networks (RNNs) on various tasks, yet they still lack several hallmarks of biological neural networks. We introduce a biologically grounded SRNN that implements Dale's law with conductance-based stands for a-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) and gamma-aminobutyric acid (GABA) reversal potentials. These reversal potentials modulate synaptic gain as a function of the postsynaptic membrane potential, and we derive theoretically how they make each neuron's effective dynamics and subthreshold resonance input-dependent. We trained SRNNs on the Spiking Heidelberg Digits (SHD) dataset and show that SRNNs with reversal potentials reduce spike energy by up to 3 × , while maintaining, or increasing, task accuracy. This leads to high-performing Dalean SRNNs that substantially improve on Dalean networks without reversal potentials. SRNNs with reversal potentials exhibited spike-train statistics closer to Poisson statistics, similar to biological neurons, and showed a substantial reduction in oscillatory activity, leading to increased heterogeneity in response properties. Thus, Dale's law with reversal potentials, a core feature of biological neural networks, can render SRNNs more accurate and energy-efficient.
Miguel Rodrigues, Carmen Gasco-Galvez, Martin A. Vinck· Frontiers in Computational N...· 0 citations
This work introduces a Temporal Feedback Coding (TFC) scheme that leverages feedback at the encoding stage to diversify spike patterns and designs a Global-Local Dynamic LIF (GLD-LIF) neuron that enhances cross-step dependency modeling by integrating local aggregation and global initialization.
It is aimed at proving that SNNs have potential in such areas as computer vision, robotics, and speech recognition, and their role in overcoming the barrier between artificial and biological neural systems is proved.
Mesala Sravani, K. Kumari, S. M. Reddy· International Journal of Unc...· 0 citations