基于快速多级开关 (Co-Fe-B)x(LiNbO3)100-x 纳米复合忆阻器横条阵列的改良型 MLP-Mixer 网络

IF 6.6 2区 材料科学 Q1 CHEMISTRY, PHYSICAL
Aleksandr I. Iliasov, Anna N. Matsukatova, Andrey V. Emelyanov, Pavel S. Slepov, Kristina E. Nikiruy and Vladimir V. Rylkov
{"title":"基于快速多级开关 (Co-Fe-B)x(LiNbO3)100-x 纳米复合忆阻器横条阵列的改良型 MLP-Mixer 网络","authors":"Aleksandr I. Iliasov, Anna N. Matsukatova, Andrey V. Emelyanov, Pavel S. Slepov, Kristina E. Nikiruy and Vladimir V. Rylkov","doi":"10.1039/D3NH00421J","DOIUrl":null,"url":null,"abstract":"<p >MLP-Mixer based on multilayer perceptrons (MLPs) is a novel architecture of a neuromorphic computing system (NCS) introduced for image classification tasks without convolutional layers. Its software realization demonstrates high classification accuracy, although the number of trainable weights is relatively low. One more promising way of improving the NCS performance, especially in terms of power consumption, is its hardware realization using memristors. Therefore, in this work, we proposed an NCS with an adapted MLP-Mixer architecture and memristive weights. For this purpose, we used a passive crossbar array of (Co–Fe–B)<small><sub><em>x</em></sub></small>(LiNbO<small><sub>3</sub></small>)<small><sub>100−<em>x</em></sub></small> memristors. Firstly, we studied the characteristics of such memristors, including their minimal resistive switching time, which was extrapolated to be in the picosecond range. Secondly, we created a fully hardware NCS with memristive weights that are capable of classification of simple 4-bit vectors. The system was shown to be robust to noise introduction in the input patterns. Finally, we used experimental memristive characteristics to simulate an adapted MLP-Mixer architecture that demonstrated a classification accuracy of (94.7 ± 0.3)% on the Modified National Institute of Standards and Technology (MNIST) dataset. The obtained results are the first steps toward the realization of memristive NCS with a promising MLP-Mixer architecture.</p>","PeriodicalId":93,"journal":{"name":"Nanoscale Horizons","volume":" 2","pages":" 238-247"},"PeriodicalIF":6.6000,"publicationDate":"2023-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Adapted MLP-Mixer network based on crossbar arrays of fast and multilevel switching (Co–Fe–B)x(LiNbO3)100−x nanocomposite memristors†\",\"authors\":\"Aleksandr I. Iliasov, Anna N. Matsukatova, Andrey V. Emelyanov, Pavel S. Slepov, Kristina E. Nikiruy and Vladimir V. Rylkov\",\"doi\":\"10.1039/D3NH00421J\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p >MLP-Mixer based on multilayer perceptrons (MLPs) is a novel architecture of a neuromorphic computing system (NCS) introduced for image classification tasks without convolutional layers. Its software realization demonstrates high classification accuracy, although the number of trainable weights is relatively low. One more promising way of improving the NCS performance, especially in terms of power consumption, is its hardware realization using memristors. Therefore, in this work, we proposed an NCS with an adapted MLP-Mixer architecture and memristive weights. For this purpose, we used a passive crossbar array of (Co–Fe–B)<small><sub><em>x</em></sub></small>(LiNbO<small><sub>3</sub></small>)<small><sub>100−<em>x</em></sub></small> memristors. Firstly, we studied the characteristics of such memristors, including their minimal resistive switching time, which was extrapolated to be in the picosecond range. Secondly, we created a fully hardware NCS with memristive weights that are capable of classification of simple 4-bit vectors. The system was shown to be robust to noise introduction in the input patterns. Finally, we used experimental memristive characteristics to simulate an adapted MLP-Mixer architecture that demonstrated a classification accuracy of (94.7 ± 0.3)% on the Modified National Institute of Standards and Technology (MNIST) dataset. The obtained results are the first steps toward the realization of memristive NCS with a promising MLP-Mixer architecture.</p>\",\"PeriodicalId\":93,\"journal\":{\"name\":\"Nanoscale Horizons\",\"volume\":\" 2\",\"pages\":\" 238-247\"},\"PeriodicalIF\":6.6000,\"publicationDate\":\"2023-12-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Nanoscale Horizons\",\"FirstCategoryId\":\"88\",\"ListUrlMain\":\"https://pubs.rsc.org/en/content/articlelanding/2024/nh/d3nh00421j\",\"RegionNum\":2,\"RegionCategory\":\"材料科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CHEMISTRY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nanoscale Horizons","FirstCategoryId":"88","ListUrlMain":"https://pubs.rsc.org/en/content/articlelanding/2024/nh/d3nh00421j","RegionNum":2,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

摘要

MLP-Mixer是一种新的神经形态计算系统(NCS)架构,用于无卷积层的图像分类任务。其软件实现显示出较高的分类准确率,但可训练权值的数量相对较少。提高NCS性能的一个更有希望的方法,特别是在功耗方面,是使用忆阻器的硬件实现。因此,在这项工作中,我们提出了一个具有适应性MLP-Mixer架构和记忆权值的NCS。为此,我们使用了(Co-Fe-B)x(LiNbO3)100−x忆阻器的无源交叉棒阵列。首先,我们研究了这种忆阻器的特性,包括其最小电阻开关时间,外推其在皮秒范围内。其次,我们创建了一个具有记忆权值的全硬件NCS,能够对简单的4位向量进行分类。结果表明,该系统对输入模式中的噪声具有较强的鲁棒性。最后,我们使用记忆特性的实验数据来模拟一个适应的MLP-Mixer架构,该架构在MNIST数据集上的分类准确率为(94.7±0.3)%。所获得的结果是用有前途的MLP-Mixer架构实现记忆性NCS的第一步。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Adapted MLP-Mixer network based on crossbar arrays of fast and multilevel switching (Co–Fe–B)x(LiNbO3)100−x nanocomposite memristors†

Adapted MLP-Mixer network based on crossbar arrays of fast and multilevel switching (Co–Fe–B)x(LiNbO3)100−x nanocomposite memristors†

MLP-Mixer based on multilayer perceptrons (MLPs) is a novel architecture of a neuromorphic computing system (NCS) introduced for image classification tasks without convolutional layers. Its software realization demonstrates high classification accuracy, although the number of trainable weights is relatively low. One more promising way of improving the NCS performance, especially in terms of power consumption, is its hardware realization using memristors. Therefore, in this work, we proposed an NCS with an adapted MLP-Mixer architecture and memristive weights. For this purpose, we used a passive crossbar array of (Co–Fe–B)x(LiNbO3)100−x memristors. Firstly, we studied the characteristics of such memristors, including their minimal resistive switching time, which was extrapolated to be in the picosecond range. Secondly, we created a fully hardware NCS with memristive weights that are capable of classification of simple 4-bit vectors. The system was shown to be robust to noise introduction in the input patterns. Finally, we used experimental memristive characteristics to simulate an adapted MLP-Mixer architecture that demonstrated a classification accuracy of (94.7 ± 0.3)% on the Modified National Institute of Standards and Technology (MNIST) dataset. The obtained results are the first steps toward the realization of memristive NCS with a promising MLP-Mixer architecture.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Nanoscale Horizons
Nanoscale Horizons Materials Science-General Materials Science
CiteScore
16.30
自引率
1.00%
发文量
141
期刊介绍: Nanoscale Horizons stands out as a premier journal for publishing exceptionally high-quality and innovative nanoscience and nanotechnology. The emphasis lies on original research that introduces a new concept or a novel perspective (a conceptual advance), prioritizing this over reporting technological improvements. Nevertheless, outstanding articles showcasing truly groundbreaking developments, including record-breaking performance, may also find a place in the journal. Published work must be of substantial general interest to our broad and diverse readership across the nanoscience and nanotechnology community.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信