Pu Gong

A Comparative Study of Gradient Descent and Stochastic Gradient Descent in Neural Network Function Approximation

The study shows how optimization techniques influence neural network training behavior and it combines mathematical optimization theory with real model performance.