High performance artificial visual perception and recognition with a plasmon-enhanced 2D material neural network.

IF 14.7 1区 综合性期刊 Q1 MULTIDISCIPLINARY SCIENCES
Tian Zhang, Xin Guo, Pan Wang, Xinyi Fan, Zichen Wang, Yan Tong, Decheng Wang, Limin Tong, Linjun Li
{"title":"High performance artificial visual perception and recognition with a plasmon-enhanced 2D material neural network.","authors":"Tian Zhang, Xin Guo, Pan Wang, Xinyi Fan, Zichen Wang, Yan Tong, Decheng Wang, Limin Tong, Linjun Li","doi":"10.1038/s41467-024-46867-8","DOIUrl":null,"url":null,"abstract":"<p><p>The development of neuromorphic visual systems has recently gained momentum due to their potential in areas such as autonomous vehicles and robotics. However, current machine visual systems based on silicon technology usually contain photosensor arrays, format conversion, memory and processing modules. As a result, the redundant data shuttling between each unit, resulting in large latency and high-power consumption, seriously limits the performance of neuromorphic vision chips. Here, we demonstrate an artificial neural network (ANN) architecture based on an integrated 2D MoS<sub>2</sub>/Ag nanograting phototransistor array, which can simultaneously sense, pre-process and recognize optical images without latency. The pre-processing function of the device under photoelectric synergy ensures considerable improvement of efficiency and accuracy of subsequent image recognition. The comprehensive performance of the proof-of-concept device demonstrates great potential for machine vision applications in terms of large dynamic range (180 dB), high speed (500 ns) and low energy consumption per spike (2.4 × 10<sup>-17 </sup>J).</p>","PeriodicalId":19066,"journal":{"name":"Nature Communications","volume":"15 1","pages":"2471"},"PeriodicalIF":14.7000,"publicationDate":"2024-03-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10951348/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nature Communications","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1038/s41467-024-46867-8","RegionNum":1,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

The development of neuromorphic visual systems has recently gained momentum due to their potential in areas such as autonomous vehicles and robotics. However, current machine visual systems based on silicon technology usually contain photosensor arrays, format conversion, memory and processing modules. As a result, the redundant data shuttling between each unit, resulting in large latency and high-power consumption, seriously limits the performance of neuromorphic vision chips. Here, we demonstrate an artificial neural network (ANN) architecture based on an integrated 2D MoS2/Ag nanograting phototransistor array, which can simultaneously sense, pre-process and recognize optical images without latency. The pre-processing function of the device under photoelectric synergy ensures considerable improvement of efficiency and accuracy of subsequent image recognition. The comprehensive performance of the proof-of-concept device demonstrates great potential for machine vision applications in terms of large dynamic range (180 dB), high speed (500 ns) and low energy consumption per spike (2.4 × 10-17 J).

Abstract Image

利用等离子体增强型二维材料神经网络实现高性能人工视觉感知和识别。
由于神经形态视觉系统在自动驾驶汽车和机器人等领域的潜力,其发展势头近来日益强劲。然而,目前基于硅技术的机器视觉系统通常包含光传感器阵列、格式转换、内存和处理模块。因此,每个单元之间的冗余数据穿梭导致了较大的延迟和高能耗,严重限制了神经形态视觉芯片的性能。在此,我们展示了一种基于集成二维 MoS2/Ag 纳米光电晶体管阵列的人工神经网络(ANN)架构,该架构可同时感测、预处理和识别光学图像,且无延迟。该设备在光电协同作用下的预处理功能可确保大幅提高后续图像识别的效率和准确性。概念验证设备的综合性能显示了其在机器视觉应用方面的巨大潜力,包括大动态范围(180 dB)、高速度(500 ns)和低能耗(2.4 × 10-17 J)。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Nature Communications
Nature Communications Biological Science Disciplines-
CiteScore
24.90
自引率
2.40%
发文量
6928
审稿时长
3.7 months
期刊介绍: Nature Communications, an open-access journal, publishes high-quality research spanning all areas of the natural sciences. Papers featured in the journal showcase significant advances relevant to specialists in each respective field. With a 2-year impact factor of 16.6 (2022) and a median time of 8 days from submission to the first editorial decision, Nature Communications is committed to rapid dissemination of research findings. As a multidisciplinary journal, it welcomes contributions from biological, health, physical, chemical, Earth, social, mathematical, applied, and engineering sciences, aiming to highlight important breakthroughs within each domain.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信