Aleksandr I. Iliasov, Anna N. Matsukatova, Andrey V. Emelyanov, Pavel S. Slepov, Kristina E. Nikiruy and Vladimir V. Rylkov
{"title":"基于快速多级开关 (Co-Fe-B)x(LiNbO3)100-x 纳米复合忆阻器横条阵列的改良型 MLP-Mixer 网络","authors":"Aleksandr I. Iliasov, Anna N. Matsukatova, Andrey V. Emelyanov, Pavel S. Slepov, Kristina E. Nikiruy and Vladimir V. Rylkov","doi":"10.1039/D3NH00421J","DOIUrl":null,"url":null,"abstract":"<p >MLP-Mixer based on multilayer perceptrons (MLPs) is a novel architecture of a neuromorphic computing system (NCS) introduced for image classification tasks without convolutional layers. Its software realization demonstrates high classification accuracy, although the number of trainable weights is relatively low. One more promising way of improving the NCS performance, especially in terms of power consumption, is its hardware realization using memristors. Therefore, in this work, we proposed an NCS with an adapted MLP-Mixer architecture and memristive weights. For this purpose, we used a passive crossbar array of (Co–Fe–B)<small><sub><em>x</em></sub></small>(LiNbO<small><sub>3</sub></small>)<small><sub>100−<em>x</em></sub></small> memristors. Firstly, we studied the characteristics of such memristors, including their minimal resistive switching time, which was extrapolated to be in the picosecond range. Secondly, we created a fully hardware NCS with memristive weights that are capable of classification of simple 4-bit vectors. The system was shown to be robust to noise introduction in the input patterns. Finally, we used experimental memristive characteristics to simulate an adapted MLP-Mixer architecture that demonstrated a classification accuracy of (94.7 ± 0.3)% on the Modified National Institute of Standards and Technology (MNIST) dataset. The obtained results are the first steps toward the realization of memristive NCS with a promising MLP-Mixer architecture.</p>","PeriodicalId":93,"journal":{"name":"Nanoscale Horizons","volume":" 2","pages":" 238-247"},"PeriodicalIF":6.6000,"publicationDate":"2023-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Adapted MLP-Mixer network based on crossbar arrays of fast and multilevel switching (Co–Fe–B)x(LiNbO3)100−x nanocomposite memristors†\",\"authors\":\"Aleksandr I. Iliasov, Anna N. Matsukatova, Andrey V. Emelyanov, Pavel S. Slepov, Kristina E. Nikiruy and Vladimir V. Rylkov\",\"doi\":\"10.1039/D3NH00421J\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p >MLP-Mixer based on multilayer perceptrons (MLPs) is a novel architecture of a neuromorphic computing system (NCS) introduced for image classification tasks without convolutional layers. Its software realization demonstrates high classification accuracy, although the number of trainable weights is relatively low. One more promising way of improving the NCS performance, especially in terms of power consumption, is its hardware realization using memristors. Therefore, in this work, we proposed an NCS with an adapted MLP-Mixer architecture and memristive weights. For this purpose, we used a passive crossbar array of (Co–Fe–B)<small><sub><em>x</em></sub></small>(LiNbO<small><sub>3</sub></small>)<small><sub>100−<em>x</em></sub></small> memristors. Firstly, we studied the characteristics of such memristors, including their minimal resistive switching time, which was extrapolated to be in the picosecond range. Secondly, we created a fully hardware NCS with memristive weights that are capable of classification of simple 4-bit vectors. The system was shown to be robust to noise introduction in the input patterns. Finally, we used experimental memristive characteristics to simulate an adapted MLP-Mixer architecture that demonstrated a classification accuracy of (94.7 ± 0.3)% on the Modified National Institute of Standards and Technology (MNIST) dataset. The obtained results are the first steps toward the realization of memristive NCS with a promising MLP-Mixer architecture.</p>\",\"PeriodicalId\":93,\"journal\":{\"name\":\"Nanoscale Horizons\",\"volume\":\" 2\",\"pages\":\" 238-247\"},\"PeriodicalIF\":6.6000,\"publicationDate\":\"2023-12-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Nanoscale Horizons\",\"FirstCategoryId\":\"88\",\"ListUrlMain\":\"https://pubs.rsc.org/en/content/articlelanding/2024/nh/d3nh00421j\",\"RegionNum\":2,\"RegionCategory\":\"材料科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CHEMISTRY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nanoscale Horizons","FirstCategoryId":"88","ListUrlMain":"https://pubs.rsc.org/en/content/articlelanding/2024/nh/d3nh00421j","RegionNum":2,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, PHYSICAL","Score":null,"Total":0}
Adapted MLP-Mixer network based on crossbar arrays of fast and multilevel switching (Co–Fe–B)x(LiNbO3)100−x nanocomposite memristors†
MLP-Mixer based on multilayer perceptrons (MLPs) is a novel architecture of a neuromorphic computing system (NCS) introduced for image classification tasks without convolutional layers. Its software realization demonstrates high classification accuracy, although the number of trainable weights is relatively low. One more promising way of improving the NCS performance, especially in terms of power consumption, is its hardware realization using memristors. Therefore, in this work, we proposed an NCS with an adapted MLP-Mixer architecture and memristive weights. For this purpose, we used a passive crossbar array of (Co–Fe–B)x(LiNbO3)100−x memristors. Firstly, we studied the characteristics of such memristors, including their minimal resistive switching time, which was extrapolated to be in the picosecond range. Secondly, we created a fully hardware NCS with memristive weights that are capable of classification of simple 4-bit vectors. The system was shown to be robust to noise introduction in the input patterns. Finally, we used experimental memristive characteristics to simulate an adapted MLP-Mixer architecture that demonstrated a classification accuracy of (94.7 ± 0.3)% on the Modified National Institute of Standards and Technology (MNIST) dataset. The obtained results are the first steps toward the realization of memristive NCS with a promising MLP-Mixer architecture.
期刊介绍:
Nanoscale Horizons stands out as a premier journal for publishing exceptionally high-quality and innovative nanoscience and nanotechnology. The emphasis lies on original research that introduces a new concept or a novel perspective (a conceptual advance), prioritizing this over reporting technological improvements. Nevertheless, outstanding articles showcasing truly groundbreaking developments, including record-breaking performance, may also find a place in the journal. Published work must be of substantial general interest to our broad and diverse readership across the nanoscience and nanotechnology community.