2D Time-Stretching Anisotropic Synapse Realizing In-Sensor Intensity-Spanning Visual Feature Fusion.

IF 27.4 1区 材料科学 Q1 CHEMISTRY, MULTIDISCIPLINARY
Decai Ouyang, Mengqi Wang, Na Zhang, Wenke He, Da Huo, Yuan Li, Tianyou Zhai
{"title":"2D Time-Stretching Anisotropic Synapse Realizing In-Sensor Intensity-Spanning Visual Feature Fusion.","authors":"Decai Ouyang, Mengqi Wang, Na Zhang, Wenke He, Da Huo, Yuan Li, Tianyou Zhai","doi":"10.1002/adma.202507168","DOIUrl":null,"url":null,"abstract":"<p><p>High-dynamic-range (HDR) visual environments, where extremely bright and dark regions coexist, pose major challenges for conventional imaging systems that rely on multi-frame exposure fusion and cloud-based post-processing. These approaches often suffer from high latency, limited efficiency, and privacy concerns, making them unsuitable for real-time or edge-level intelligent vision. Here, a 2D Time-Stretching Anisotropic Synapse (2D TSAS) is reported that enables in-sensor intensity-spanning feature fusion from a single image frame. The 2D TSAS uniquely integrates two key features of NbOI<sub>2</sub> material: in-plane anisotropy, which gives rise to polarization-resolved optical responses, and a time-stretching photoresponse arising from multi-channel transition-relaxation. This dual-mode mechanism enables direct encoding and temporal integration of spatial-polarization and luminance features during photoexcitation. Leveraging this behavior, a neuromorphic preprocessing strategy is constructed for single-shot visual learning across extreme brightness domains. The system achieves accelerated model convergence with minimal training loss, reaching recognition accuracies of ≈95.41% on NWPU-RESISC45 and ≈95.39% on MNIST. This work offers a compact and efficient solution for contrast-adaptive intelligent vision in complex real-world environments.</p>","PeriodicalId":114,"journal":{"name":"Advanced Materials","volume":" ","pages":"e2507168"},"PeriodicalIF":27.4000,"publicationDate":"2025-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Materials","FirstCategoryId":"88","ListUrlMain":"https://doi.org/10.1002/adma.202507168","RegionNum":1,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

High-dynamic-range (HDR) visual environments, where extremely bright and dark regions coexist, pose major challenges for conventional imaging systems that rely on multi-frame exposure fusion and cloud-based post-processing. These approaches often suffer from high latency, limited efficiency, and privacy concerns, making them unsuitable for real-time or edge-level intelligent vision. Here, a 2D Time-Stretching Anisotropic Synapse (2D TSAS) is reported that enables in-sensor intensity-spanning feature fusion from a single image frame. The 2D TSAS uniquely integrates two key features of NbOI2 material: in-plane anisotropy, which gives rise to polarization-resolved optical responses, and a time-stretching photoresponse arising from multi-channel transition-relaxation. This dual-mode mechanism enables direct encoding and temporal integration of spatial-polarization and luminance features during photoexcitation. Leveraging this behavior, a neuromorphic preprocessing strategy is constructed for single-shot visual learning across extreme brightness domains. The system achieves accelerated model convergence with minimal training loss, reaching recognition accuracies of ≈95.41% on NWPU-RESISC45 and ≈95.39% on MNIST. This work offers a compact and efficient solution for contrast-adaptive intelligent vision in complex real-world environments.

二维时间拉伸各向异性突触实现传感器内跨越强度的视觉特征融合。
高动态范围(HDR)视觉环境,其中极端明亮和黑暗区域共存,对依赖多帧曝光融合和基于云的后处理的传统成像系统构成了重大挑战。这些方法通常存在高延迟、有限效率和隐私问题,因此不适合用于实时或边缘级智能视觉。本文报道了一种2D时间拉伸各向异性突触(2D TSAS),该突触能够从单个图像帧中实现传感器内跨越强度的特征融合。二维TSAS独特地集成了NbOI2材料的两个关键特征:平面内各向异性,这导致了偏振分辨的光学响应,以及多通道过渡弛豫引起的时间拉伸光响应。这种双模机制实现了光激发过程中空间偏振和亮度特征的直接编码和时间整合。利用这种行为,构建了一种神经形态预处理策略,用于跨极端亮度域的单镜头视觉学习。该系统以最小的训练损失实现了模型的加速收敛,在NWPU-RESISC45和MNIST上分别达到了≈95.41%和≈95.39%的识别准确率。这项工作为复杂现实环境中的对比度自适应智能视觉提供了一种紧凑高效的解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Advanced Materials
Advanced Materials 工程技术-材料科学:综合
CiteScore
43.00
自引率
4.10%
发文量
2182
审稿时长
2 months
期刊介绍: Advanced Materials, one of the world's most prestigious journals and the foundation of the Advanced portfolio, is the home of choice for best-in-class materials science for more than 30 years. Following this fast-growing and interdisciplinary field, we are considering and publishing the most important discoveries on any and all materials from materials scientists, chemists, physicists, engineers as well as health and life scientists and bringing you the latest results and trends in modern materials-related research every week.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信