Bio-inspired “Self-denoising” capability of 2D materials incorporated optoelectronic synaptic array

IF 9.1 2区 材料科学 Q1 MATERIALS SCIENCE, MULTIDISCIPLINARY
Molla Manjurul Islam, Md Sazzadur Rahman, Haley Heldmyer, Sang Sub Han, Yeonwoong Jung, Tania Roy
{"title":"Bio-inspired “Self-denoising” capability of 2D materials incorporated optoelectronic synaptic array","authors":"Molla Manjurul Islam, Md Sazzadur Rahman, Haley Heldmyer, Sang Sub Han, Yeonwoong Jung, Tania Roy","doi":"10.1038/s41699-024-00458-9","DOIUrl":null,"url":null,"abstract":"In in-sensor image preprocessing, the sensed image undergoes low level processing like denoising at the sensor end, similar to the retina of human eye. Optoelectronic synapse devices are potential contenders for this purpose, and subsequent applications in artificial neural networks (ANNs). The optoelectronic synapses can offer image pre-processing functionalities at the pixel itself—termed as in-pixel computing. Denoising is an important problem in image preprocessing and several approaches have been used to denoise the input images. While most of those approaches require external circuitry, others are efficient only when the noisy pixels have significantly lower intensity compared to the actual pattern pixels. In this work, we present the innate ability of an optoelectronic synapse array to perform denoising at the pixel itself once it is trained to memorize an image. The synapses consist of phototransistors with bilayer MoS2 channel and p-Si/PtTe2 buried gate electrode. Our 7 × 7 array shows excellent robustness to noise due to the interplay between long-term potentiation and short-term potentiation. This bio-inspired strategy enables denoising of noise with higher intensity than the memorized pattern, without the use of any external circuitry. Specifically, due to the ability of these synapses to respond distinctively to wavelengths from 300 nm in ultraviolet to 2 µm in infrared, the pixel array also denoises mixed-color interferences. The “self-denoising” capability of such an artificial visual array has the capacity to eliminate the need for raw data transmission and thus, reduce subsequent image processing steps for supervised learning.","PeriodicalId":19227,"journal":{"name":"npj 2D Materials and Applications","volume":" ","pages":"1-10"},"PeriodicalIF":9.1000,"publicationDate":"2024-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s41699-024-00458-9.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"npj 2D Materials and Applications","FirstCategoryId":"88","ListUrlMain":"https://www.nature.com/articles/s41699-024-00458-9","RegionNum":2,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATERIALS SCIENCE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

In in-sensor image preprocessing, the sensed image undergoes low level processing like denoising at the sensor end, similar to the retina of human eye. Optoelectronic synapse devices are potential contenders for this purpose, and subsequent applications in artificial neural networks (ANNs). The optoelectronic synapses can offer image pre-processing functionalities at the pixel itself—termed as in-pixel computing. Denoising is an important problem in image preprocessing and several approaches have been used to denoise the input images. While most of those approaches require external circuitry, others are efficient only when the noisy pixels have significantly lower intensity compared to the actual pattern pixels. In this work, we present the innate ability of an optoelectronic synapse array to perform denoising at the pixel itself once it is trained to memorize an image. The synapses consist of phototransistors with bilayer MoS2 channel and p-Si/PtTe2 buried gate electrode. Our 7 × 7 array shows excellent robustness to noise due to the interplay between long-term potentiation and short-term potentiation. This bio-inspired strategy enables denoising of noise with higher intensity than the memorized pattern, without the use of any external circuitry. Specifically, due to the ability of these synapses to respond distinctively to wavelengths from 300 nm in ultraviolet to 2 µm in infrared, the pixel array also denoises mixed-color interferences. The “self-denoising” capability of such an artificial visual array has the capacity to eliminate the need for raw data transmission and thus, reduce subsequent image processing steps for supervised learning.

Abstract Image

融入光电突触阵列的二维材料的生物启发 "自变型 "能力
在传感器内图像预处理中,传感图像在传感器端进行去噪等低级处理,类似于人眼的视网膜。光电突触设备是实现这一目的以及随后在人工神经网络(ANN)中应用的潜在竞争者。光电突触可在像素本身提供图像预处理功能,即像素内计算。去噪是图像预处理中的一个重要问题,已有多种方法用于对输入图像进行去噪。其中大多数方法需要外部电路,而其他方法只有在噪声像素的强度明显低于实际图案像素时才有效。在这项工作中,我们展示了光电突触阵列的内在能力,一旦经过训练记住了图像,它就能在像素本身进行去噪。突触由带有双层 MoS2 沟道和 p-Si/PtTe2 埋栅极的光电晶体管组成。由于长期电位和短期电位之间的相互作用,我们的 7 × 7 阵列对噪声表现出卓越的鲁棒性。这种生物启发策略无需使用任何外部电路,就能对强度高于记忆模式的噪声进行去噪处理。具体来说,由于这些突触能够对从紫外线 300 纳米到红外线 2 微米的波长做出独特的反应,像素阵列还能对混合色干扰进行去噪。这种人工视觉阵列的 "自我去噪 "能力无需传输原始数据,从而减少了后续图像处理步骤,便于监督学习。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
npj 2D Materials and Applications
npj 2D Materials and Applications Engineering-Mechanics of Materials
CiteScore
14.50
自引率
2.10%
发文量
80
审稿时长
15 weeks
期刊介绍: npj 2D Materials and Applications publishes papers on the fundamental behavior, synthesis, properties and applications of existing and emerging 2D materials. By selecting papers with the potential for impact, the journal aims to facilitate the transfer of the research of 2D materials into wide-ranging applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信