Convergence Analysis of Newton's Method for Neural Networks in the Overparameterized Limit
A convergence analysis is developed for the regularized Newton method for training neural networks (NNs) in the overparameterized limit and it is proved that the NN converges exponentially fast to the target data (i.e., a global minimizer with zero loss).