Spiking forecasting framework SpikeLite is introduced, a spiking forecasting framework built around two modules: a Frequency-Selective Spiking Encoder for frequency-sensitive temporal encoding and a Sparse Spiking Channel Attention (SSCA) module for selective cross-channel interaction.
Bang Hu, Chang-Ze Lv, Ming-Jie Li et al.· 0 citations
Large language models (LLMs) achieve strong performance across many tasks but rely on dense multiply-accumulate (MAC) operations during inference, resulting in high energy cost. Spiking neural networks (SNNs) offer an event-driven alternative in which synaptic integration uses lightweight accumulation. However, spike-d...
Bang Hu, Guo-Wei Zhu, Changze Lv et al.· 0 citations
This work proposes ATAC, an anchor-tail aware framework for jointly optimizing packed-document construction and context-parallel sharding in large language model training and demonstrates that input-structure-aware co-design of packing and context parallelism is an effective approach to improving calibrated pipeline-le...
Zhengyu Liu, Shuai-Kang Hou, Yan-Zhao Gao et al.· Journal of King Saud Univers...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.