Introducing an Evolutionary Algorithm for the Optimal Training of RBF Networks

Abstract

A large collection of real-world classification and regression problems can be addressed using machine learning tools such as, for example, radial basis function networks (RBF networks). However, the techniques used for training RBF networks often exhibit various problems, such as getting trapped in the local minima of the error function, or even encountering numerical issues when solving systems of linear equations in order to estimate the parameters of the RBF network. This paper presents a multi-stage evolutionary technique based on genetic algorithms for the effective training of RBF networks. In the first stage, the value ranges of the RBF network parameters are estimated using the K-Means algorithm. In the second stage, the chromosomes of the genetic algorithm are initialized within the parameter ranges determined in the first stage, followed by the execution of the genetic algorithm. Each chromosome of the genetic algorithm is considered a candidate parameter vector for the machine learning model. The centers and variances of the RBF network are estimated by the genetic algorithm, while the network weights are determined by solving a system of linear equations. This method was applied to a large set of classification and data-fitting problems, yielding excellent results.