Junxu Li

Exact Realization of Deep ReLU Computation in a Microscopic Statistical-Mechanical System

Understanding the physical origin of the piecewise-linear computation in deep rectified linear unit (ReLU) networks remains a fundamental challenge. Here we establish an exact statistical-mechanical realization of arbitrary ReLU networks. Starting from a microscopic configuration space and its state multiplicities, we...