Comparison of Particle Swarm Optimization and Backpropagation Algorithms for Training Feedforward Neural Network


Authors

Nasser Mohammadi - Department of computer engineering, Tehran Science and Research Branch, Islamic Azad University, Damavand, Iran. Seyed Javad Mirabedini - Department of computer engineering, Central Tehran Branch, Islamic Azad University, Tehran, Iran.


Abstract

An interesting tool for non-linear multivariable modeling is the Artificial Neural Network (ANN) which has been developed recently. The use of ANN has been proved to be a cost-effective technique. It is very important to choose a suitable algorithm for training a neural network. Generally Backpropagation (BP) algorithm is used to train the neural network. While these algorithms prove to be very effective and robust in training many types of network structures, they suffer from certain disadvantages such as easy entrapment in a local minimum and very slow convergence. In this paper, to improve the performance of ANN, the adjustment of network weights using Particle Swarm Optimization (PSO) was proposed as a mechanism and the results obtained were compared with various BP algorithms such as Levenberg-Marquardt and gradient descent algorithms. Each of these networks runs and trains for different learning ratios, activation functions and numbers of neurons within their hidden layer. Among different criteria Mean Square Error (MSE) and Accuracy are the main selected criteria used for evaluating both models. Also the MSE was used as a criterion to specify optimum number of neurons in hidden layer. The results showed that PSO approach outperforms the BP for training neural network models.


Share and Cite

  • Share on Facebook
  • Share on Twitter
  • Share on LinkedIn
ISRP Style

Nasser Mohammadi, Seyed Javad Mirabedini, Comparison of Particle Swarm Optimization and Backpropagation Algorithms for Training Feedforward Neural Network, Journal of Mathematics and Computer Science, 12 (2014), no. 2, 113-123

AMA Style

Mohammadi Nasser, Mirabedini Seyed Javad, Comparison of Particle Swarm Optimization and Backpropagation Algorithms for Training Feedforward Neural Network. J Math Comput SCI-JM. (2014); 12(2):113-123

Chicago/Turabian Style

Mohammadi, Nasser, Mirabedini, Seyed Javad. "Comparison of Particle Swarm Optimization and Backpropagation Algorithms for Training Feedforward Neural Network." Journal of Mathematics and Computer Science, 12, no. 2 (2014): 113-123


Keywords


MSC


References