Training neural networks via simplified hybrid algorithm mixing Nelder-Mead and particle swarm optimization methods

Verfasser / Beitragende:
[Shih-Hui Liao, Jer-Guang Hsieh, Jyh-Yeong Chang, Chin-Teng Lin]
Ort, Verlag, Jahr:
2015
Enthalten in:
Soft Computing, 19/3(2015-03-01), 679-689
Format:
Artikel (online)
ID: 605469512
LEADER caa a22 4500
001 605469512
003 CHVBK
005 20210128100322.0
007 cr unu---uuuuu
008 210128e20150301xx s 000 0 eng
024 7 0 |a 10.1007/s00500-014-1292-y  |2 doi 
035 |a (NATIONALLICENCE)springer-10.1007/s00500-014-1292-y 
245 0 0 |a Training neural networks via simplified hybrid algorithm mixing Nelder-Mead and particle swarm optimization methods  |h [Elektronische Daten]  |c [Shih-Hui Liao, Jer-Guang Hsieh, Jyh-Yeong Chang, Chin-Teng Lin] 
520 3 |a In this paper, a new and simplified hybrid algorithm mixing the simplex method of Nelder and Mead (NM) and particle swarm optimization algorithm (PSO), abbreviated as SNM-PSO, is proposed for the training of the parameters of the Artificial Neural Network (ANN). Our method differs from other hybrid PSO methods in that, $$n+1$$ n + 1 particles, where $$n$$ n is the dimension of the search space, are randomly selected (without sorting), at each iteration of the proposed algorithm for use as the initial vertices of the NM algorithm, and each such particle is replaced by the corresponding final vertex after executing the NM algorithm. All the particles are then updated using the standard PSO algorithm. Our proposed method is simpler than other similar hybrid PSO methods and places more emphasis on the exploration of the search space. Some simulation problems will be provided to compare the performances of the proposed method with PSO and other similar hybrid PSO methods in training an ANN. These simulations show that the proposed method outperforms the other compared methods. 
540 |a Springer-Verlag Berlin Heidelberg, 2014 
690 7 |a Artificial Neural Network (ANN)  |2 nationallicence 
690 7 |a Particle swarm optimization (PSO)  |2 nationallicence 
690 7 |a Simplex method of Nelder and Mead (NM)  |2 nationallicence 
700 1 |a Liao  |D Shih-Hui  |u Department of Electrical and Control Engineering, National Chiao Tung University, 1001 University Road, 300, Hsinchu, Taiwan, ROC  |4 aut 
700 1 |a Hsieh  |D Jer-Guang  |u Department of Electrical Engineering, I-Shou University, Kaohsiung County, Taiwan  |4 aut 
700 1 |a Chang  |D Jyh-Yeong  |u Department of Electrical and Control Engineering, National Chiao Tung University, 1001 University Road, 300, Hsinchu, Taiwan, ROC  |4 aut 
700 1 |a Lin  |D Chin-Teng  |u Department of Electrical and Control Engineering, National Chiao Tung University, 1001 University Road, 300, Hsinchu, Taiwan, ROC  |4 aut 
773 0 |t Soft Computing  |d Springer Berlin Heidelberg  |g 19/3(2015-03-01), 679-689  |x 1432-7643  |q 19:3<679  |1 2015  |2 19  |o 500 
856 4 0 |u https://doi.org/10.1007/s00500-014-1292-y  |q text/html  |z Onlinezugriff via DOI 
898 |a BK010053  |b XK010053  |c XK010000 
900 7 |a Metadata rights reserved  |b Springer special CC-BY-NC licence  |2 nationallicence 
908 |D 1  |a research-article  |2 jats 
949 |B NATIONALLICENCE  |F NATIONALLICENCE  |b NL-springer 
950 |B NATIONALLICENCE  |P 856  |E 40  |u https://doi.org/10.1007/s00500-014-1292-y  |q text/html  |z Onlinezugriff via DOI 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Liao  |D Shih-Hui  |u Department of Electrical and Control Engineering, National Chiao Tung University, 1001 University Road, 300, Hsinchu, Taiwan, ROC  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Hsieh  |D Jer-Guang  |u Department of Electrical Engineering, I-Shou University, Kaohsiung County, Taiwan  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Chang  |D Jyh-Yeong  |u Department of Electrical and Control Engineering, National Chiao Tung University, 1001 University Road, 300, Hsinchu, Taiwan, ROC  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Lin  |D Chin-Teng  |u Department of Electrical and Control Engineering, National Chiao Tung University, 1001 University Road, 300, Hsinchu, Taiwan, ROC  |4 aut 
950 |B NATIONALLICENCE  |P 773  |E 0-  |t Soft Computing  |d Springer Berlin Heidelberg  |g 19/3(2015-03-01), 679-689  |x 1432-7643  |q 19:3<679  |1 2015  |2 19  |o 500