NeuroFlex is the first accelerator to assign every output element independently to ANN or SNN execution mode with zero accuracy loss, and extends integer-exact ANN-SNN equivalence from layers to individual output elements, thereby enabling mode switching with no conversion error.
Abstract
Sparse DNN accelerators specialize in ANN or SNN execution, leaving energy or latency on the table when workload characteristics vary within a layer. Hybrid accelerator designs that switch modes at layer or tile granularity suffer from low PE utilization since one core type idles whenever the other is active. NeuroFlex is the first accelerator to assign every output element independently to ANN or SNN execution mode with zero accuracy loss. We extend integer-exact ANN-SNN equivalence from layers to individual output elements, thereby enabling mode switching with no conversion error. An offline cost-guided scheduler scores each element by its marginal energy-delay trade-off and packs work across PEs, achieving 97-99% PE utilization compared to 40-45% for layer-wise hybrids. NeuroFlex reduces EDP by 57-67% over a strong ANN-only baseline and delivers up to 2.5x speedup over a dual-sparse SNN-only baseline. Our cost-guided scheduler improves throughput by 16-19% over random element assignment across vision, language, and transformer workloads.
Spiking neural networks (SNNs) expose sparse event activity, but commodity microcontrollers increasingly pair general-purpose processors with dense matrix-vector accelerators whose suitability for sparse inference is unclear. We investigate whether the on-chip Matrix Vector Processor (MVP) of the EFR32MG24 can accelera...
Muhammad Fahd Ibrahim Bhatti, Muhammad Ali Siddiqi· 0 citations
Mixture-of-experts (MoE) models expand model capacity by activating only a subset of experts for each token. On accelerators with static execution plans, expert capacities and placement are fixed before routing reveals each expert's load. Uniform worst-case capacities waste work on padding; smaller capacities tied to e...
Wen-Tao Ni, Chi-Hao Yu, Hong Cai et al.· 0 citations
Deep neural network (DNN) accelerators for edge inference must meet tight energy, latency, and area (EDP) constraints, and their optimal hardware architecture and dataflow configuration is typically identified through design space exploration (DSE). However, on-chip memory technology including cell type, bank organizat...
Tanvi Sharma, Surya Selvam, Anand Raghunathan et al.· 0 citations
Machine learning inference is moving to the edge due to latency, energy, and privacy constraints. The growing complexity of edge workloads places increasing pressure on memory hierarchies, making data movement a major limitation for both performance and energy efficiency. Fixed-function accelerators inherit the memory...
Vincenzo Petrolo, Flavia Guella, G. Masera et al.· Computers· 0 citations
The high and balanced efficiencies prove that learning can be unified with high-performance inference without efficiency compromise for adaptive edge artificial intelligence (AI).
Yue Zuo, N. Ning, Zhi-Qiang Su et al.· IEEE Transactions on Very La...· 0 citations
With the rapid growth of deep learning models, compiler optimization for heterogeneous accelerators has become critical to improving execution efficiency. Compared with GPUs, Neural Processing Units (NPUs) offer stronger domain-specific computing capability but impose more complex on-chip resource constraints. Existing...
Jia-Nan Li, Lin Han, Xiao-Nan Chai et al.· IEEE Access· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduNov 17, 2026
By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.
Microsoft Research Blog· microsoft.comNov 16, 2026
AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduNov 13, 2026