Single Dendritic Neural Classification with Functional Weight-enhanced Differential Evolution

Ziqian Wang, Kaiyu Wang, Jiaru Yang, Zheng Tang
{"title":"Single Dendritic Neural Classification with Functional Weight-enhanced Differential Evolution","authors":"Ziqian Wang, Kaiyu Wang, Jiaru Yang, Zheng Tang","doi":"10.1109/PIC53636.2021.9687059","DOIUrl":null,"url":null,"abstract":"As current mainstream deep learning models based on neural networks have been long criticized because of their complex structures, attempts in formulating a single neural model have raised much attention. Owing to the nonlinear information processing ability, dendritic neuron model (DNM) has shown its great potential in classification problems over the past decades. However, designing an effective learning algorithm for training DNM is still an open question due to the issues of local optima trapping and overfiting caused by traditional back-propagation (BP) algorithm. In this study, a novel functional weight-enhanced differential evolutionary algorithm (termed FWDE) is proposed to solve the aforementioned problems. By introducing Gaussian distribution function into weight generation of fitness-distance balance selection strategy, FWDE obtains significantly better classification accuracy with faster convergence speed compared with other representative non-BP and BP algorithms. The experimental results verify the great performance of FWDE, indicating that DNM with an powerful learning algorithm is considerably more effective.","PeriodicalId":297239,"journal":{"name":"2021 IEEE International Conference on Progress in Informatics and Computing (PIC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Progress in Informatics and Computing (PIC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/PIC53636.2021.9687059","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

As current mainstream deep learning models based on neural networks have been long criticized because of their complex structures, attempts in formulating a single neural model have raised much attention. Owing to the nonlinear information processing ability, dendritic neuron model (DNM) has shown its great potential in classification problems over the past decades. However, designing an effective learning algorithm for training DNM is still an open question due to the issues of local optima trapping and overfiting caused by traditional back-propagation (BP) algorithm. In this study, a novel functional weight-enhanced differential evolutionary algorithm (termed FWDE) is proposed to solve the aforementioned problems. By introducing Gaussian distribution function into weight generation of fitness-distance balance selection strategy, FWDE obtains significantly better classification accuracy with faster convergence speed compared with other representative non-BP and BP algorithms. The experimental results verify the great performance of FWDE, indicating that DNM with an powerful learning algorithm is considerably more effective.
单树突神经分类与功能权重增强的差异进化
由于当前主流的基于神经网络的深度学习模型结构复杂,长期以来一直受到批评,因此,构建单一神经网络模型的尝试引起了人们的关注。近年来,树突状神经元模型(DNM)由于其非线性信息处理能力,在分类问题中显示出巨大的潜力。然而,由于传统的BP算法存在局部最优捕获和过拟合问题,设计一种有效的训练DNM的学习算法仍然是一个悬而未决的问题。本文提出了一种新的功能权重增强差分进化算法(FWDE)来解决上述问题。通过将高斯分布函数引入到适应度距离平衡选择策略的权值生成中,与其他代表性的非BP和BP算法相比,FWDE算法的分类精度显著提高,收敛速度更快。实验结果验证了FWDE的良好性能,表明具有强大学习算法的DNM更有效。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信