Accelerating Neural Network-Based Regression and Classification Tasks through Empirical Kernels
Results suggest, and experimental evidence corroborates, that kernel machines relying on empirical kernels extracted from trained DNNs can act as surrogates for trained finite-width DNNs, and determine regimes where both kernel machines trained on features extracted from an underlying DNN are demonstrably superior to t...