用于完全灵活的神经形态机器视觉系统的灵活视网膜视觉传感器,具有光感和光感适应功能

SmartMat Pub Date : 2024-04-12 DOI:10.1002/smm2.1285
Lei Shi, Ke Shi, Zhi-Cheng Zhang, Yuan Li, Fu‐Dong Wang, Shu‐Han Si, Zhi‐Bo Liu, Tong‐Bu Lu, Xu‐Dong Chen, Jin Zhang
{"title":"用于完全灵活的神经形态机器视觉系统的灵活视网膜视觉传感器,具有光感和光感适应功能","authors":"Lei Shi, Ke Shi, Zhi-Cheng Zhang, Yuan Li, Fu‐Dong Wang, Shu‐Han Si, Zhi‐Bo Liu, Tong‐Bu Lu, Xu‐Dong Chen, Jin Zhang","doi":"10.1002/smm2.1285","DOIUrl":null,"url":null,"abstract":"Bioinspired neuromorphic machine vision system (NMVS) that integrates retinomorphic sensing and neuromorphic computing into one monolithic system is regarded as the most promising architecture for visual perception. However, the large intensity range of natural lights and complex illumination conditions in actual scenarios always require the NMVS to dynamically adjust its sensitivity according to the environmental conditions, just like the visual adaptation function of the human retina. Although some opto‐sensors with scotopic or photopic adaption have been developed, NMVSs, especially fully flexible NMVSs, with both scotopic and photopic adaptation functions are rarely reported. Here we propose an ion‐modulation strategy to dynamically adjust the photosensitivity and time‐varying activation/inhibition characteristics depending on the illumination conditions, and develop a flexible ion‐modulated phototransistor array based on MoS2/graphdiyne heterostructure, which can execute both retinomorphic sensing and neuromorphic computing. By controlling the intercalated Li+ ions in graphdiyne, both scotopic and photopic adaptation functions are demonstrated successfully. A fully flexible NMVS consisting of front‐end retinomorphic vision sensors and a back‐end convolutional neural network is constructed based on the as‐fabricated 28 × 28 device array, demonstrating quite high recognition accuracies for both dim and bright images and robust flexibility. This effort for fully flexible and monolithic NMVS paves the way for its applications in wearable scenarios.","PeriodicalId":21794,"journal":{"name":"SmartMat","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-04-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Flexible retinomorphic vision sensors with scotopic and photopic adaptation for a fully flexible neuromorphic machine vision system\",\"authors\":\"Lei Shi, Ke Shi, Zhi-Cheng Zhang, Yuan Li, Fu‐Dong Wang, Shu‐Han Si, Zhi‐Bo Liu, Tong‐Bu Lu, Xu‐Dong Chen, Jin Zhang\",\"doi\":\"10.1002/smm2.1285\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Bioinspired neuromorphic machine vision system (NMVS) that integrates retinomorphic sensing and neuromorphic computing into one monolithic system is regarded as the most promising architecture for visual perception. However, the large intensity range of natural lights and complex illumination conditions in actual scenarios always require the NMVS to dynamically adjust its sensitivity according to the environmental conditions, just like the visual adaptation function of the human retina. Although some opto‐sensors with scotopic or photopic adaption have been developed, NMVSs, especially fully flexible NMVSs, with both scotopic and photopic adaptation functions are rarely reported. Here we propose an ion‐modulation strategy to dynamically adjust the photosensitivity and time‐varying activation/inhibition characteristics depending on the illumination conditions, and develop a flexible ion‐modulated phototransistor array based on MoS2/graphdiyne heterostructure, which can execute both retinomorphic sensing and neuromorphic computing. By controlling the intercalated Li+ ions in graphdiyne, both scotopic and photopic adaptation functions are demonstrated successfully. A fully flexible NMVS consisting of front‐end retinomorphic vision sensors and a back‐end convolutional neural network is constructed based on the as‐fabricated 28 × 28 device array, demonstrating quite high recognition accuracies for both dim and bright images and robust flexibility. This effort for fully flexible and monolithic NMVS paves the way for its applications in wearable scenarios.\",\"PeriodicalId\":21794,\"journal\":{\"name\":\"SmartMat\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-04-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"SmartMat\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1002/smm2.1285\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"SmartMat","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1002/smm2.1285","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

生物启发神经形态机器视觉系统(NMVS)将视网膜形态传感和神经形态计算整合为一个整体系统,被认为是最有前途的视觉感知架构。然而,实际场景中自然光的强度范围大,光照条件复杂,NMVS 总是需要根据环境条件动态调整灵敏度,就像人类视网膜的视觉适应功能一样。虽然目前已经开发出了一些具有焦距或光度自适应功能的光传感器,但同时具有焦距和光度自适应功能的 NMVS,尤其是完全灵活的 NMVS 还鲜有报道。在这里,我们提出了一种离子调制策略,以根据光照条件动态调节光敏性和时变激活/抑制特性,并开发出一种基于 MoS2/graphdiyne 异质结构的柔性离子调制光电晶体管阵列,它既能执行视网膜形态传感,又能执行神经形态计算。通过控制石墨二炔中夹杂的 Li+ 离子,成功地展示了散光适应和光敏适应功能。基于已制造完成的 28 × 28 器件阵列,构建了一个由前端视网膜视觉传感器和后端卷积神经网络组成的完全灵活的 NMVS,在昏暗和明亮的图像中均表现出相当高的识别准确率和强大的灵活性。这种完全灵活的单片式 NMVS 为其在可穿戴场景中的应用铺平了道路。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Flexible retinomorphic vision sensors with scotopic and photopic adaptation for a fully flexible neuromorphic machine vision system
Bioinspired neuromorphic machine vision system (NMVS) that integrates retinomorphic sensing and neuromorphic computing into one monolithic system is regarded as the most promising architecture for visual perception. However, the large intensity range of natural lights and complex illumination conditions in actual scenarios always require the NMVS to dynamically adjust its sensitivity according to the environmental conditions, just like the visual adaptation function of the human retina. Although some opto‐sensors with scotopic or photopic adaption have been developed, NMVSs, especially fully flexible NMVSs, with both scotopic and photopic adaptation functions are rarely reported. Here we propose an ion‐modulation strategy to dynamically adjust the photosensitivity and time‐varying activation/inhibition characteristics depending on the illumination conditions, and develop a flexible ion‐modulated phototransistor array based on MoS2/graphdiyne heterostructure, which can execute both retinomorphic sensing and neuromorphic computing. By controlling the intercalated Li+ ions in graphdiyne, both scotopic and photopic adaptation functions are demonstrated successfully. A fully flexible NMVS consisting of front‐end retinomorphic vision sensors and a back‐end convolutional neural network is constructed based on the as‐fabricated 28 × 28 device array, demonstrating quite high recognition accuracies for both dim and bright images and robust flexibility. This effort for fully flexible and monolithic NMVS paves the way for its applications in wearable scenarios.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信