Modified Dropout and Maxout based on the MNN for improving accuracy

Chao Wang, Xiaojing Zha, Yinshui Xia
{"title":"Modified Dropout and Maxout based on the MNN for improving accuracy","authors":"Chao Wang, Xiaojing Zha, Yinshui Xia","doi":"10.1109/ICSICT49897.2020.9278252","DOIUrl":null,"url":null,"abstract":"Memristor crossbar array is an emerged architecture suitable for matrix computation. Memristor based neural networks (MNN) address the speed and energy efficiency issues in computing hardware. However, there are still a lot of problems with memristor, and the limited size of memristor crossbar resulting in the accuracy of the MNN is lower than conventional neural networks (CNNs). In this paper, a modified Dropout and Maxout based MNN for improving the accuracy of the MNN is proposed. A three-layer memristor based multilayer Perceptron (MLP) in 64*128 crossbar is built to perform MNIST image recognition. The experiment results demonstrate that the in-situ training of the MLP achieves a high accuracy near 96.5% with Dropout and Maxout.","PeriodicalId":6727,"journal":{"name":"2020 IEEE 15th International Conference on Solid-State & Integrated Circuit Technology (ICSICT)","volume":"46 1","pages":"1-3"},"PeriodicalIF":0.0000,"publicationDate":"2020-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE 15th International Conference on Solid-State & Integrated Circuit Technology (ICSICT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSICT49897.2020.9278252","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

Memristor crossbar array is an emerged architecture suitable for matrix computation. Memristor based neural networks (MNN) address the speed and energy efficiency issues in computing hardware. However, there are still a lot of problems with memristor, and the limited size of memristor crossbar resulting in the accuracy of the MNN is lower than conventional neural networks (CNNs). In this paper, a modified Dropout and Maxout based MNN for improving the accuracy of the MNN is proposed. A three-layer memristor based multilayer Perceptron (MLP) in 64*128 crossbar is built to perform MNIST image recognition. The experiment results demonstrate that the in-situ training of the MLP achieves a high accuracy near 96.5% with Dropout and Maxout.
改进了基于MNN的Dropout和Maxout,提高了精度
忆阻交叉栅阵列是一种新兴的适合于矩阵计算的结构。基于忆阻器的神经网络(MNN)解决了计算硬件中的速度和能效问题。然而,忆阻器仍然存在很多问题,忆阻器横条尺寸的限制导致MNN的精度低于传统的神经网络(cnn)。为了提高MNN的精度,本文提出了一种改进的基于Dropout和Maxout的MNN算法。构建了一种基于三层忆阻器的64*128横条多层感知器(MLP),用于MNIST图像识别。实验结果表明,基于Dropout和Maxout的MLP原位训练准确率接近96.5%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信