Syed Kumayl Raza Moosavi, M. Zafar, Malik Naveed Akhter, Shahzaib Farooq Hadi, Noman Mujeeb Khan, Filippo Sanfilippo
{"title":"一种基于蜉蝣算法的人工神经网络(ANN)","authors":"Syed Kumayl Raza Moosavi, M. Zafar, Malik Naveed Akhter, Shahzaib Farooq Hadi, Noman Mujeeb Khan, Filippo Sanfilippo","doi":"10.1109/ICoDT252288.2021.9441473","DOIUrl":null,"url":null,"abstract":"Training of Artificial Neural Networks (ANNs) have been improved over the years using meta heuristic algorithms that introduce randomness into the training method but they might be prone to falling into a local minima in a high-dimensional space and have low convergence rate with the iterative process. To cater for the inefficiencies of training such an ANN, a novel neural network is presented in this paper using the bio-inspired algorithm of the movement and mating of the mayflies. The proposed Mayfly algorithm is explored as a means to update weights and biases of the neural network. As compared to previous meta heuristic algorithms, the proposed approach finds the global minima cost at far less number of iterations and with higher accuracy. The network proposed, which is named Mayfly Algorithm based Neural Network (MFANN) consists of an input layer, a single hidden layer of 10 neurons and an output layer. Two University of California Irvine (UCI) database sample datasets have been used as benchmark for this study, namely the Banknote Authentication (BA) and the Cryotherapy, for which the training accuracy achieved is 99.2350% and 96.6102%, whereas the Testing accuracy is 99.1247% and 90% respectively. Comparative study with grey wolf optimization neural network (GWONN) and particle swarm optimization neural network (PSONN) reveal that the proposed MFANN achieves 1–2% better accuracy with training dataset and 2% better accuracy with testing dataset.","PeriodicalId":207832,"journal":{"name":"2021 International Conference on Digital Futures and Transformative Technologies (ICoDT2)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":"{\"title\":\"A Novel Artificial Neural Network (ANN) Using The Mayfly Algorithm for Classification\",\"authors\":\"Syed Kumayl Raza Moosavi, M. Zafar, Malik Naveed Akhter, Shahzaib Farooq Hadi, Noman Mujeeb Khan, Filippo Sanfilippo\",\"doi\":\"10.1109/ICoDT252288.2021.9441473\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Training of Artificial Neural Networks (ANNs) have been improved over the years using meta heuristic algorithms that introduce randomness into the training method but they might be prone to falling into a local minima in a high-dimensional space and have low convergence rate with the iterative process. To cater for the inefficiencies of training such an ANN, a novel neural network is presented in this paper using the bio-inspired algorithm of the movement and mating of the mayflies. The proposed Mayfly algorithm is explored as a means to update weights and biases of the neural network. As compared to previous meta heuristic algorithms, the proposed approach finds the global minima cost at far less number of iterations and with higher accuracy. The network proposed, which is named Mayfly Algorithm based Neural Network (MFANN) consists of an input layer, a single hidden layer of 10 neurons and an output layer. Two University of California Irvine (UCI) database sample datasets have been used as benchmark for this study, namely the Banknote Authentication (BA) and the Cryotherapy, for which the training accuracy achieved is 99.2350% and 96.6102%, whereas the Testing accuracy is 99.1247% and 90% respectively. Comparative study with grey wolf optimization neural network (GWONN) and particle swarm optimization neural network (PSONN) reveal that the proposed MFANN achieves 1–2% better accuracy with training dataset and 2% better accuracy with testing dataset.\",\"PeriodicalId\":207832,\"journal\":{\"name\":\"2021 International Conference on Digital Futures and Transformative Technologies (ICoDT2)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-05-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"5\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 International Conference on Digital Futures and Transformative Technologies (ICoDT2)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICoDT252288.2021.9441473\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 International Conference on Digital Futures and Transformative Technologies (ICoDT2)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICoDT252288.2021.9441473","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 5
摘要
近年来,引入随机性的元启发式算法对人工神经网络的训练进行了改进,但在高维空间中容易陷入局部极小值,且迭代过程的收敛速度较低。为了解决这种人工神经网络训练效率低下的问题,本文提出了一种基于蜉蝣运动和交配的仿生算法的新型神经网络。本文探讨了Mayfly算法作为一种更新神经网络权值和偏置的方法。与以往的元启发式算法相比,该方法能够以更少的迭代次数和更高的精度找到全局最小代价。所提出的网络被命名为基于Mayfly算法的神经网络(MFANN),该网络由一个输入层、一个包含10个神经元的单个隐藏层和一个输出层组成。本研究采用加州大学欧文分校(University of California Irvine, UCI)的两个数据库样本数据集作为基准,分别是Banknote Authentication (BA)和Cryotherapy,其训练准确率分别为99.2350%和96.6102%,而Testing准确率分别为99.1247%和90%。与灰狼优化神经网络(GWONN)和粒子群优化神经网络(PSONN)的对比研究表明,本文提出的MFANN在训练数据集上的准确率提高了1-2%,在测试数据集上的准确率提高了2%。
A Novel Artificial Neural Network (ANN) Using The Mayfly Algorithm for Classification
Training of Artificial Neural Networks (ANNs) have been improved over the years using meta heuristic algorithms that introduce randomness into the training method but they might be prone to falling into a local minima in a high-dimensional space and have low convergence rate with the iterative process. To cater for the inefficiencies of training such an ANN, a novel neural network is presented in this paper using the bio-inspired algorithm of the movement and mating of the mayflies. The proposed Mayfly algorithm is explored as a means to update weights and biases of the neural network. As compared to previous meta heuristic algorithms, the proposed approach finds the global minima cost at far less number of iterations and with higher accuracy. The network proposed, which is named Mayfly Algorithm based Neural Network (MFANN) consists of an input layer, a single hidden layer of 10 neurons and an output layer. Two University of California Irvine (UCI) database sample datasets have been used as benchmark for this study, namely the Banknote Authentication (BA) and the Cryotherapy, for which the training accuracy achieved is 99.2350% and 96.6102%, whereas the Testing accuracy is 99.1247% and 90% respectively. Comparative study with grey wolf optimization neural network (GWONN) and particle swarm optimization neural network (PSONN) reveal that the proposed MFANN achieves 1–2% better accuracy with training dataset and 2% better accuracy with testing dataset.