Hui-Ru Luo

PNTAFormer: polarity-aware neighborhood token attention for spiking transformers

PNTAFormer, which incorporates PNT-Attention, enhances token attention by integrating two critical components: (1) 2D local neighborhood aggregation through depthwise convolution to capture spatial context, and (2) excitatory-inhibitory competition driven by membrane polarity in spiking neurons, enabling the model to e...