{"title":"The union optimization method of multilayer perceptron","authors":"Chen Yongsheng, Liang Biqing, Y. Baozong","doi":"10.1109/TENCON.1993.320126","DOIUrl":null,"url":null,"abstract":"The backpropagation algorithm (BP) is one of the most popular algorithms in neural network studies, but it is notorious for its slowness in achieving convergence. Based on the theory of unconstrained optimization, the union optimization method (UOM) is presented. The method consists of two parts: apply Descent Method to optimize objective function E=/spl Sigmasub p/E/sub p/; when E</spl epsi/, apply conjugate gradient method to optimize objective function. Apply the UOM to train speech pattern, the experiment result shows the convergence speed of UOM is fourteen times faster than conventional BP algorithm.<<ETX>>","PeriodicalId":110496,"journal":{"name":"Proceedings of TENCON '93. IEEE Region 10 International Conference on Computers, Communications and Automation","volume":"23 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"1993-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of TENCON '93. IEEE Region 10 International Conference on Computers, Communications and Automation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/TENCON.1993.320126","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
The backpropagation algorithm (BP) is one of the most popular algorithms in neural network studies, but it is notorious for its slowness in achieving convergence. Based on the theory of unconstrained optimization, the union optimization method (UOM) is presented. The method consists of two parts: apply Descent Method to optimize objective function E=/spl Sigmasub p/E/sub p/; when E>