This work introduces a modular and scalable architecture called ODEONN that is generic to multiple applications of ONNs, and to the best of the knowledge, is the first fully digital ONN to also support complex-valued coupling.
Abstract
Oscillatory Neural Networks (ONNs) are an alternative computing paradigm for AI and combinatorial optimization problems. However, digital architectures are often designed for specific applications of ONNs. This work introduces a modular and scalable architecture called ODEONN that is generic to multiple applications of ONNs, and to the best of our knowledge, is the first fully digital ONN to also support complex-valued coupling. Additionally, an approximation of the sine function is introduced that uses half of the hardware resources compared to standard methods. The performance of ODEONN is compared with a full-precision software simulation, where a performance degradation of less than $2\%$ is shown. Therefore, we conclude that the fixed-point quantization and the approximated waveform affect the accuracy of computation by only a small amount. Furthermore, ODEONN shows a 45$\times$ reduction in energy-delay product over the software simulation running on conventional hardware.
It is shown that multi-bit packets, rather than spikes, are the most efficient communication strategy in packet-switched networks and that compared to basic numerical integration methods, higher-order differential equation solvers decrease both computation and communication costs while achieving lower numerical error,...
Jakob Jordan, Ole Richter, Cong Li et al.· 0 citations
Numerical simulations show that correlations in the stochastic weight evolution significantly affect the system response, suggesting a potential mechanism for neuromorphic-inspired computation without conventional weight training.
Simulation is central to modern engineering and science, but the cost of numerical solvers for partial differential equations (PDEs) remains a bottleneck whenever fast or many-query evaluations are required. Neural emulators trained on solver-generated data promise significant speedups, yet they are usually framed as o...
This paper applied a circuit implemented ReLU Hopfield Neural Network to a mathematical problem with an inequality constraint and implemented a circuit and observed converged neural circuit outputs that corresponded well to theoretical results and simulations.
Ryosei Okubo, Y. Mitsuya, Hiroyuki Takahashi· Frontiers in Neuroscience· 0 citations
An approach is presented which proposes the embedding of a neural network based architecture as a substitute for the state function of an ODE into established Runge–Kutta based integration method.
Timo Bielitz, Dieter Bestle· Proceedings in Applied Mathe...· 0 citations
SpiKFAX is proposed, a second-order optimization method that formulates a computationally tractable, Kronecker-factored approximation of the Fisher information matrix specifically adapted to the structure of SNNs.
Ngoc Phu Doan, Ihsen Alouani· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.