Yan Liu, Yuanquan Liu, Qiang Shao, Rui Wang, Yan Lv
{"title":"一阶高木-杉野模糊模型的新型神经模糊学习算法:卡普托分阶梯度下降法","authors":"Yan Liu, Yuanquan Liu, Qiang Shao, Rui Wang, Yan Lv","doi":"10.1007/s40815-024-01750-y","DOIUrl":null,"url":null,"abstract":"<p>As an essential tool for processing fuzzy or chaotic information, the main feature of the first-order Takagi–Sugeno (T–S) neuro-fuzzy model is utilizing a set of IF-THEN fuzzy rules to represent non-linear systems, showcasing commendable non-linear approximation ability and significant interpretability. However, the coexistence of linear rules and the affiliation function of fuzzy sets makes the integer-order gradient descent method (IOGDM), commonly used in training the first-order T–S neuro-fuzzy model, fail to accurately capture the intricate relationships among weights, resulting in the error function struggling to converge rapidly to low values. To enhance the convergence speed and training accuracy of the first-order T–S neuro-fuzzy model during the training process, a fractional-order gradient descent method (FOGDM) is proposed to update the fuzzy rule parameters and neural network weights of the model in this paper. By subdividing the gradient into fractional orders, FOGDM exhibits heightened flexibility in gradient adjustments, thus better capturing the complex non-linear relationships among parameters during the optimization process. The weak and strong convergence of the proposed approach is meticulously demonstrated in this paper, ensuring that the weight of error functions converges to a constant value and that the gradient of the error functions tends toward zero, respectively. Simulation results analysis indicates that, compared to IOGDM, FOGDM exhibits faster convergence speed and more significant generalization capabilities.</p>","PeriodicalId":14056,"journal":{"name":"International Journal of Fuzzy Systems","volume":"103 1","pages":""},"PeriodicalIF":3.6000,"publicationDate":"2024-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Novel Neuro-fuzzy Learning Algorithm for First-Order Takagi–Sugeno Fuzzy Model: Caputo Fractional-Order Gradient Descent Method\",\"authors\":\"Yan Liu, Yuanquan Liu, Qiang Shao, Rui Wang, Yan Lv\",\"doi\":\"10.1007/s40815-024-01750-y\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>As an essential tool for processing fuzzy or chaotic information, the main feature of the first-order Takagi–Sugeno (T–S) neuro-fuzzy model is utilizing a set of IF-THEN fuzzy rules to represent non-linear systems, showcasing commendable non-linear approximation ability and significant interpretability. However, the coexistence of linear rules and the affiliation function of fuzzy sets makes the integer-order gradient descent method (IOGDM), commonly used in training the first-order T–S neuro-fuzzy model, fail to accurately capture the intricate relationships among weights, resulting in the error function struggling to converge rapidly to low values. To enhance the convergence speed and training accuracy of the first-order T–S neuro-fuzzy model during the training process, a fractional-order gradient descent method (FOGDM) is proposed to update the fuzzy rule parameters and neural network weights of the model in this paper. By subdividing the gradient into fractional orders, FOGDM exhibits heightened flexibility in gradient adjustments, thus better capturing the complex non-linear relationships among parameters during the optimization process. The weak and strong convergence of the proposed approach is meticulously demonstrated in this paper, ensuring that the weight of error functions converges to a constant value and that the gradient of the error functions tends toward zero, respectively. Simulation results analysis indicates that, compared to IOGDM, FOGDM exhibits faster convergence speed and more significant generalization capabilities.</p>\",\"PeriodicalId\":14056,\"journal\":{\"name\":\"International Journal of Fuzzy Systems\",\"volume\":\"103 1\",\"pages\":\"\"},\"PeriodicalIF\":3.6000,\"publicationDate\":\"2024-06-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Fuzzy Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1007/s40815-024-01750-y\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Fuzzy Systems","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s40815-024-01750-y","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
A Novel Neuro-fuzzy Learning Algorithm for First-Order Takagi–Sugeno Fuzzy Model: Caputo Fractional-Order Gradient Descent Method
As an essential tool for processing fuzzy or chaotic information, the main feature of the first-order Takagi–Sugeno (T–S) neuro-fuzzy model is utilizing a set of IF-THEN fuzzy rules to represent non-linear systems, showcasing commendable non-linear approximation ability and significant interpretability. However, the coexistence of linear rules and the affiliation function of fuzzy sets makes the integer-order gradient descent method (IOGDM), commonly used in training the first-order T–S neuro-fuzzy model, fail to accurately capture the intricate relationships among weights, resulting in the error function struggling to converge rapidly to low values. To enhance the convergence speed and training accuracy of the first-order T–S neuro-fuzzy model during the training process, a fractional-order gradient descent method (FOGDM) is proposed to update the fuzzy rule parameters and neural network weights of the model in this paper. By subdividing the gradient into fractional orders, FOGDM exhibits heightened flexibility in gradient adjustments, thus better capturing the complex non-linear relationships among parameters during the optimization process. The weak and strong convergence of the proposed approach is meticulously demonstrated in this paper, ensuring that the weight of error functions converges to a constant value and that the gradient of the error functions tends toward zero, respectively. Simulation results analysis indicates that, compared to IOGDM, FOGDM exhibits faster convergence speed and more significant generalization capabilities.
期刊介绍:
The International Journal of Fuzzy Systems (IJFS) is an official journal of Taiwan Fuzzy Systems Association (TFSA) and is published semi-quarterly. IJFS will consider high quality papers that deal with the theory, design, and application of fuzzy systems, soft computing systems, grey systems, and extension theory systems ranging from hardware to software. Survey and expository submissions are also welcome.