Aug 2026· International Conference on Systems· pp. 273-281· 0 citations· 53 references
Computer Science
TL;DR
Shem is presented, a framework that enables gradient-based optimization of system-level objectives such as robustness and accuracy on user-defined analog compute models and introduces an autoparallelization algorithm that reduces total optimization runtime by 49–91%.
Abstract
Analog compute paradigms are gaining attention for their potential to overcome the energy and latency limits of digital systems. Analog computations are modeled as dynamical systems for design and optimization, but this process is challenging: the dynamics are governed by nonlinear differential equations without closed-form solutions, are susceptible to hardware nonidealities such as mismatch and noise, and rely on digitally programmable interfaces that complicate system-level reasoning. We present Shem , a framework that enables gradient-based optimization of system-level objectives such as robustness and accuracy on user-defined analog compute models. We leverage the fact that analog compute models are inherently differentiable, and that nonidealities and digital interfaces can be approximated by differentiable functions, making gradient descent a natural and unified approach for optimization. We evaluate Shem across diverse case studies, including an oscillator-based pattern recognizer, a cellular nonlinear network edge detector, an analog-to-information converter integrated with a neural network, and a transmission-line security primitive. In all cases, Shem improves application performance, including signal-to-noise ratio, classification accuracy, and a security metric. In addition, we introduce an autoparallelization algorithm that reduces total optimization runtime by 49–91%.
Deep resistive networks are electronic energy-based systems in which computation is performed by the steady-state voltages of nonlinear circuits. Nonlinear devices enable expressive input-output transformations, but make the circuit equilibria costly to compute during simulation and training. Recent coordinate-descent...
Filip Osana, J. Grollier, D. Querlioz· 0 citations
Analog in-memory computing (AIMC) offers an alternative for model training by executing matrix operations directly where weights are stored. However, scaling AIMC to train modern deep models remains an open challenge due to severe hardware non-idealities, including physical weights with finite dynamic range and write g...
Zhao-Xian Wu, Tayfun Gokmen, Omobayode I. Fagbohungbe et al.· 1 citation
This work introduces a modular and scalable architecture called ODEONN that is generic to multiple applications of ONNs, and to the best of the knowledge, is the first fully digital ONN to also support complex-valued coupling.
Neuromorphic engineering began with the idea that the physical behavior of a system could itself be used for computation, taking inspiration from the way nervous systems sense, adapt, and evolve in time. The field has since expanded far beyond its early analog circuits to include event-based sensors, spiking processors...
The success of large-scale AI relies on the phenomenon of double descent, where overfitting first increases and then counterintuitively decreases as the network grows relative to the amount of training data and becomes overparameterized. In this overparameterized regime it is easy to find good solutions that do not ove...
Sam Dillavou, Jason W. Rocks, Jacob F. Wycoff et al.· Proceedings of the National...· 0 citations
The operator eml(x, y) = exp(x) - ln(y) with the constant 1 generates the elementary functions, a continuous counterpart to NAND. Whether it yields a useful fabric had not been asked of hardware. We ask in network models, circuit simulation and SkyWater 130 nm layout. Four bipolar junctions evaluate the operator for 13...
Christof Teuscher· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.