Skip to content

NeuroFlex: Lossless Element-Level ANN-SNN Co-Execution for Efficient Sparse Inference

Nov 2025 · 0 citations · 27 references
Computer Science

TL;DR

NeuroFlex is the first accelerator to assign every output element independently to ANN or SNN execution mode with zero accuracy loss, and extends integer-exact ANN-SNN equivalence from layers to individual output elements, thereby enabling mode switching with no conversion error.

Abstract

Sparse DNN accelerators specialize in ANN or SNN execution, leaving energy or latency on the table when workload characteristics vary within a layer. Hybrid accelerator designs that switch modes at layer or tile granularity suffer from low PE utilization since one core type idles whenever the other is active. NeuroFlex is the first accelerator to assign every output element independently to ANN or SNN execution mode with zero accuracy loss. We extend integer-exact ANN-SNN equivalence from layers to individual output elements, thereby enabling mode switching with no conversion error. An offline cost-guided scheduler scores each element by its marginal energy-delay trade-off and packs work across PEs, achieving 97-99% PE utilization compared to 40-45% for layer-wise hybrids. NeuroFlex reduces EDP by 57-67% over a strong ANN-only baseline and delivers up to 2.5x speedup over a dual-sparse SNN-only baseline. Our cost-guided scheduler improves throughput by 16-19% over random element assignment across vision, language, and transformer workloads.

View source

Similar papers

Preprint Oct 2026

SpikeDuet: CPU-Accelerator Co-Execution of Sparse SNNs on Commodity MCUs

Spiking neural networks (SNNs) expose sparse event activity, but commodity microcontrollers increasingly pair general-purpose processors with dense matrix-vector accelerators whose suitability for sparse inference is unclear. We investigate whether the on-chip Matrix Vector Processor (MVP) of the EFR32MG24 can accelera...

Muhammad Fahd Ibrahim Bhatti, Muhammad Ali Siddiqi · 0 citations
Preprint Oct 2026

RankLane: Efficient MoE Prefill on Accelerators with Ranked Expert Capacities

Mixture-of-experts (MoE) models expand model capacity by activating only a subset of experts for each token. On accelerators with static execution plans, expert capacities and placement are fixed before routing reveals each expert's load. Uniform worst-case capacities waste work on padding; smaller capacities tied to e...

Wen-Tao Ni, Chi-Hao Yu, Hong Cai et al. · 0 citations
Preprint Oct 2026

TADA: Technology Aware DNN Accelerator Performance and Energy Estimator

Deep neural network (DNN) accelerators for edge inference must meet tight energy, latency, and area (EDP) constraints, and their optimal hardware architecture and dataflow configuration is typically identified through design space exploration (DSE). However, on-chip memory technology including cell type, bank organizat...

Tanvi Sharma, Surya Selvam, Anand Raghunathan et al. · 0 citations
Open access Oct 2026

QUINN: Quantized Inference and Dataflow Characterization for Neural Networks on RISC-V Near-Memory Architectures

Machine learning inference is moving to the edge due to latency, energy, and privacy constraints. The growing complexity of edge workloads places increasing pressure on memory hierarchies, making data movement a major limitation for both performance and energy efficiency. Fixed-function accelerators inherit the memory...

Vincenzo Petrolo, Flavia Guella, G. Masera et al. · 0 citations
Open access 2026

TopoAxis: A Multi-Stage Compilation Optimization Framework for Neural Processing Units

With the rapid growth of deep learning models, compiler optimization for heterogeneous accelerators has become critical to improving execution efficiency. Compared with GPUs, Neural Processing Units (NPUs) offer stronger domain-specific computing capability but impose more complex on-chip resource constraints. Existing...

Jia-Nan Li, Lin Han, Xiao-Nan Chai et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

Microsoft Research Blog Nov 16, 2026

TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient

AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.