Avian eye–inspired perovskite artificial vision system for foveated and multispectral imaging

IF 26.1 1区 计算机科学 Q1 ROBOTICS
Jinhong Park, Min Seok Kim, Joonsoo Kim, Sehui Chang, Mincheol Lee, Gil Ju Lee, Young Min Song, Dae-Hyeong Kim
{"title":"Avian eye–inspired perovskite artificial vision system for foveated and multispectral imaging","authors":"Jinhong Park,&nbsp;Min Seok Kim,&nbsp;Joonsoo Kim,&nbsp;Sehui Chang,&nbsp;Mincheol Lee,&nbsp;Gil Ju Lee,&nbsp;Young Min Song,&nbsp;Dae-Hyeong Kim","doi":"10.1126/scirobotics.adk6903","DOIUrl":null,"url":null,"abstract":"<div >Avian eyes have deep central foveae as a result of extensive evolution. Deep foveae efficiently refract incident light, creating a magnified image of the target object and making it easier to track object motion. These features are essential for detecting and tracking remote objects in dynamic environments. Furthermore, avian eyes respond to a wide spectrum of light, including visible and ultraviolet light, allowing them to efficiently distinguish the target object from complex backgrounds. Despite notable advances in artificial vision systems that mimic animal vision, the exceptional object detection and targeting capabilities of avian eyes via foveated and multispectral imaging remain underexplored. Here, we present an artificial vision system that capitalizes on these aspects of avian vision. We introduce an artificial fovea and vertically stacked perovskite photodetector arrays whose designs were optimized by theoretical simulations for the demonstration of foveated and multispectral imaging. The artificial vision system successfully identifies colored and mixed-color objects and detects remote objects through foveated imaging. The potential for use in uncrewed aerial vehicles that need to detect, track, and recognize distant targets in dynamic environments is also discussed. Our avian eye–inspired perovskite artificial vision system marks a notable advance in bioinspired artificial visions.</div>","PeriodicalId":56029,"journal":{"name":"Science Robotics","volume":"9 90","pages":""},"PeriodicalIF":26.1000,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.science.org/doi/reader/10.1126/scirobotics.adk6903","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Science Robotics","FirstCategoryId":"94","ListUrlMain":"https://www.science.org/doi/10.1126/scirobotics.adk6903","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Avian eyes have deep central foveae as a result of extensive evolution. Deep foveae efficiently refract incident light, creating a magnified image of the target object and making it easier to track object motion. These features are essential for detecting and tracking remote objects in dynamic environments. Furthermore, avian eyes respond to a wide spectrum of light, including visible and ultraviolet light, allowing them to efficiently distinguish the target object from complex backgrounds. Despite notable advances in artificial vision systems that mimic animal vision, the exceptional object detection and targeting capabilities of avian eyes via foveated and multispectral imaging remain underexplored. Here, we present an artificial vision system that capitalizes on these aspects of avian vision. We introduce an artificial fovea and vertically stacked perovskite photodetector arrays whose designs were optimized by theoretical simulations for the demonstration of foveated and multispectral imaging. The artificial vision system successfully identifies colored and mixed-color objects and detects remote objects through foveated imaging. The potential for use in uncrewed aerial vehicles that need to detect, track, and recognize distant targets in dynamic environments is also discussed. Our avian eye–inspired perovskite artificial vision system marks a notable advance in bioinspired artificial visions.

Abstract Image

由鸟眼启发的用于蜂窝和多光谱成像的 perovskite 人工视觉系统。
经过广泛进化,鸟类的眼睛具有较深的中央眼窝。深眼窝能有效折射入射光,形成目标物体的放大图像,从而更容易跟踪物体的运动。这些特征对于在动态环境中探测和跟踪远处的物体至关重要。此外,鸟类的眼睛能对包括可见光和紫外线在内的宽光谱光做出反应,从而能从复杂的背景中有效地区分目标物体。尽管在模仿动物视觉的人工视觉系统方面取得了显著进展,但人们对鸟类眼睛通过视网膜成像和多光谱成像进行物体探测和目标定位的卓越能力仍缺乏深入研究。在此,我们介绍一种利用鸟类视觉这些方面的人工视觉系统。我们引入了一个人造眼窝和垂直堆叠的包晶光电探测器阵列,并通过理论模拟对其设计进行了优化,以演示眼窝成像和多光谱成像。人工视觉系统成功地识别了彩色和混合色物体,并通过眼窝成像探测到了远处的物体。此外,还讨论了该系统在需要探测、跟踪和识别动态环境中远处目标的无人驾驶飞行器中的应用潜力。我们的鸟眼启发包晶人工视觉系统标志着生物启发人工视觉的显著进步。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Science Robotics
Science Robotics Mathematics-Control and Optimization
CiteScore
30.60
自引率
2.80%
发文量
83
期刊介绍: Science Robotics publishes original, peer-reviewed, science- or engineering-based research articles that advance the field of robotics. The journal also features editor-commissioned Reviews. An international team of academic editors holds Science Robotics articles to the same high-quality standard that is the hallmark of the Science family of journals. Sub-topics include: actuators, advanced materials, artificial Intelligence, autonomous vehicles, bio-inspired design, exoskeletons, fabrication, field robotics, human-robot interaction, humanoids, industrial robotics, kinematics, machine learning, material science, medical technology, motion planning and control, micro- and nano-robotics, multi-robot control, sensors, service robotics, social and ethical issues, soft robotics, and space, planetary and undersea exploration.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信