Jason W. Rocks

Double descent without digital computation.

The success of large-scale AI relies on the phenomenon of double descent, where overfitting first increases and then counterintuitively decreases as the network grows relative to the amount of training data and becomes overparameterized. In this overparameterized regime it is easy to find good solutions that do not ove...