一种用于图像分类的改进尖峰网络转换

Thu Quyen Nguyen, Q. Pham, Chi Hoang-Phuong, Quang Hieu Dang, Duc Minh Nguyen, Hoang Nguyen-Huy
{"title":"一种用于图像分类的改进尖峰网络转换","authors":"Thu Quyen Nguyen, Q. Pham, Chi Hoang-Phuong, Quang Hieu Dang, Duc Minh Nguyen, Hoang Nguyen-Huy","doi":"10.1109/MAPR53640.2021.9585199","DOIUrl":null,"url":null,"abstract":"Image classification is always an interesting problem due to its practical applications in real life. With a capability of self-learning features, modern Convolution Neural Network (CNN) models can achieve high accuracy on large and complex benchmark datasets. However, due to their high computation costs, the CNN models experience energy consumption problems during training and implementation of the hardware which limits their utilisation in mobile and embedded applications. Recently, the Spiking Neural Network (SNN) has been proposed to overcome drawbacks of the CNN models. Like the biological nervous system, the SNN’s neurons communicate with each other by sending spike trains. A neuron is only calculated when a new input spike arrives. As a result, it turns the networks into an energy-saving mode which is suitable for implementation on hardware devices. To avoid the difficulty of the SNN direct training, an indirect training approach is proposed in this work. A proposed CNN model is firstly trained with the RMSprop algorithm then the optimised weights and bias are mapped to the SNN model converted from the proposed CNN model. Experimental results confirm that our model achieves the best accuracy of 93.5% when compared to state-of-the-art SNN approaches on the Fashion- MNIST dataset.","PeriodicalId":233540,"journal":{"name":"2021 International Conference on Multimedia Analysis and Pattern Recognition (MAPR)","volume":"118 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"An improved spiking network conversion for image classification\",\"authors\":\"Thu Quyen Nguyen, Q. Pham, Chi Hoang-Phuong, Quang Hieu Dang, Duc Minh Nguyen, Hoang Nguyen-Huy\",\"doi\":\"10.1109/MAPR53640.2021.9585199\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Image classification is always an interesting problem due to its practical applications in real life. With a capability of self-learning features, modern Convolution Neural Network (CNN) models can achieve high accuracy on large and complex benchmark datasets. However, due to their high computation costs, the CNN models experience energy consumption problems during training and implementation of the hardware which limits their utilisation in mobile and embedded applications. Recently, the Spiking Neural Network (SNN) has been proposed to overcome drawbacks of the CNN models. Like the biological nervous system, the SNN’s neurons communicate with each other by sending spike trains. A neuron is only calculated when a new input spike arrives. As a result, it turns the networks into an energy-saving mode which is suitable for implementation on hardware devices. To avoid the difficulty of the SNN direct training, an indirect training approach is proposed in this work. A proposed CNN model is firstly trained with the RMSprop algorithm then the optimised weights and bias are mapped to the SNN model converted from the proposed CNN model. Experimental results confirm that our model achieves the best accuracy of 93.5% when compared to state-of-the-art SNN approaches on the Fashion- MNIST dataset.\",\"PeriodicalId\":233540,\"journal\":{\"name\":\"2021 International Conference on Multimedia Analysis and Pattern Recognition (MAPR)\",\"volume\":\"118 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 International Conference on Multimedia Analysis and Pattern Recognition (MAPR)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/MAPR53640.2021.9585199\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 International Conference on Multimedia Analysis and Pattern Recognition (MAPR)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/MAPR53640.2021.9585199","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3

摘要

由于在现实生活中的实际应用,图像分类一直是一个有趣的问题。现代卷积神经网络(CNN)模型具有自学习特征的能力,可以在大型复杂的基准数据集上达到很高的精度。然而,由于其高昂的计算成本,CNN模型在硬件的训练和实现过程中会遇到能耗问题,这限制了它们在移动和嵌入式应用中的利用。近年来,为了克服CNN模型的缺点,提出了脉冲神经网络(SNN)。像生物神经系统一样,SNN的神经元通过发送尖峰信号来相互交流。只有当新的输入尖峰到来时,才会计算神经元。从而使网络变成一种适合在硬件设备上实现的节能模式。为了避免SNN直接训练的困难,本文提出了一种间接训练方法。首先使用RMSprop算法对所提出的CNN模型进行训练,然后将优化后的权重和偏置映射到由所提出的CNN模型转换而成的SNN模型上。实验结果证实,与Fashion- MNIST数据集上最先进的SNN方法相比,我们的模型达到了93.5%的最佳准确率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
An improved spiking network conversion for image classification
Image classification is always an interesting problem due to its practical applications in real life. With a capability of self-learning features, modern Convolution Neural Network (CNN) models can achieve high accuracy on large and complex benchmark datasets. However, due to their high computation costs, the CNN models experience energy consumption problems during training and implementation of the hardware which limits their utilisation in mobile and embedded applications. Recently, the Spiking Neural Network (SNN) has been proposed to overcome drawbacks of the CNN models. Like the biological nervous system, the SNN’s neurons communicate with each other by sending spike trains. A neuron is only calculated when a new input spike arrives. As a result, it turns the networks into an energy-saving mode which is suitable for implementation on hardware devices. To avoid the difficulty of the SNN direct training, an indirect training approach is proposed in this work. A proposed CNN model is firstly trained with the RMSprop algorithm then the optimised weights and bias are mapped to the SNN model converted from the proposed CNN model. Experimental results confirm that our model achieves the best accuracy of 93.5% when compared to state-of-the-art SNN approaches on the Fashion- MNIST dataset.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信