LYAPUNOV THEORY BASED ADAPTIVE LEARNING ALGORITHM FOR MULTILAYER NEURAL NETWORKS
dc.authorid | 0000-0002-0619-549X | |
dc.contributor.author | Acir, Nurettin | |
dc.contributor.author | Menguc, Engin Cemal | |
dc.date.accessioned | 2019-08-01T13:38:39Z | |
dc.date.available | 2019-08-01T13:38:39Z | |
dc.date.issued | 2014 | |
dc.department | Niğde ÖHÜ | |
dc.description.abstract | This paper presents a novel weight updating algorithm for training of multilayer neural network (MLNN). The MLNN system is first linearized and then the design procedure is proposed as an inequality constraint optimization problem. A well selected Lyapunov function is suitably determined and integrated into the constraint function for satisfying asymptotic stability in the sense of Lyapunov. Thus, the convergence capability of training algorithm is improved by using a new analytical adaptation gain rate which has the ability to adaptively adjust itself depending on a sequential square error rate. The proposed algorithm is compared with two types of backpropagation algorithms and a Lyapunov theory based MLNN algorithm on three benchmark problems which are XOR, 3-bit parity, and 8-3 encoder. The results are compared in terms of number of learning iterations and computational time required for a specified convergence rate. The results clearly indicate that the proposed algorithm is much faster in convergence than other three algorithms. The proposed algorithm is also comparatively tested on a real iris image database for multiple-input and multiple-output classification problem and the effect of adaptation gain rate for faster convergence and higher performance is verified. | |
dc.description.sponsorship | Nigde University [FEB-2010/32]; Scientific Research Project Unit [FEB-2010/32] | |
dc.description.sponsorship | This study has partially been supported by Nigde University, The Scientific Research Project Unit with the project number of FEB-2010/32. We also would like to thank to the authorities of Multimedia University MMU1 Iris Image Database. | |
dc.identifier.doi | 10.14311/NNW.2014.24.035 | |
dc.identifier.endpage | 636 | |
dc.identifier.issn | 1210-0552 | |
dc.identifier.issue | 6 | |
dc.identifier.scopus | 2-s2.0-84920713431 | |
dc.identifier.scopusquality | Q4 | |
dc.identifier.startpage | 619 | |
dc.identifier.uri | https://dx.doi.org/10.14311/NNW.2014.24.035 | |
dc.identifier.uri | https://hdl.handle.net/11480/4221 | |
dc.identifier.volume | 24 | |
dc.identifier.wos | WOS:000348408100004 | |
dc.identifier.wosquality | Q4 | |
dc.indekslendigikaynak | Web of Science | |
dc.indekslendigikaynak | Scopus | |
dc.institutionauthor | [0-Belirlenecek] | |
dc.language.iso | en | |
dc.publisher | ACAD SCIENCES CZECH REPUBLIC, INST COMPUTER SCIENCE | |
dc.relation.ispartof | NEURAL NETWORK WORLD | |
dc.relation.publicationcategory | Makale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı | |
dc.rights | info:eu-repo/semantics/openAccess | |
dc.subject | Lyapunov stability theory | |
dc.subject | multilayer neural network | |
dc.subject | Lagrange multiplier theory | |
dc.subject | adaptive learning | |
dc.title | LYAPUNOV THEORY BASED ADAPTIVE LEARNING ALGORITHM FOR MULTILAYER NEURAL NETWORKS | |
dc.type | Article |