A Comparative Study of Optimization Algorithms, Regularization Techniques, and CNN Architectures for CIFAR-10 Image Classification
In this paper, we perform a systematic empirical study of deep learning techniques on the CIFAR-10 image classification benchmark. We study three inter-related aspects of neural network design: (1) the relative impact of nine gradient descent optimisation algorithms on a baseline Multi-Layer Perceptron (MLP); (2) the e...