An ultrawide field-of-view pinhole compound eye using hemispherical nanowire array for robot vision

IF 26.1 1区 计算机科学 Q1 ROBOTICS
Yu Zhou, Zhibo Sun, Yucheng Ding, Zhengnan Yuan, Xiao Qiu, Yang Bryan Cao, Zhu’an Wan, Zhenghao Long, Swapnadeep Poddar, Shivam Kumar, Wenhao Ye, Chak Lam Jonathan Chan, Daquan Zhang, Beitao Ren, Qianpeng Zhang, Hoi-Sing Kwok, Mitch Guijun Li, Zhiyong Fan
{"title":"An ultrawide field-of-view pinhole compound eye using hemispherical nanowire array for robot vision","authors":"Yu Zhou,&nbsp;Zhibo Sun,&nbsp;Yucheng Ding,&nbsp;Zhengnan Yuan,&nbsp;Xiao Qiu,&nbsp;Yang Bryan Cao,&nbsp;Zhu’an Wan,&nbsp;Zhenghao Long,&nbsp;Swapnadeep Poddar,&nbsp;Shivam Kumar,&nbsp;Wenhao Ye,&nbsp;Chak Lam Jonathan Chan,&nbsp;Daquan Zhang,&nbsp;Beitao Ren,&nbsp;Qianpeng Zhang,&nbsp;Hoi-Sing Kwok,&nbsp;Mitch Guijun Li,&nbsp;Zhiyong Fan","doi":"10.1126/scirobotics.adi8666","DOIUrl":null,"url":null,"abstract":"<div >Garnering inspiration from biological compound eyes, artificial vision systems boasting a vivid range of diverse visual functional traits have come to the fore recently. However, most of these artificial systems rely on transformable electronics, which suffer from the complexity and constrained geometry of global deformation, as well as potential mismatches between optical and detector units. Here, we present a unique pinhole compound eye that combines a three-dimensionally printed honeycomb optical structure with a hemispherical, all-solid-state, high-density perovskite nanowire photodetector array. The lens-free pinhole structure can be designed and fabricated with an arbitrary layout to match the underlying image sensor. Optical simulations and imaging results matched well with each other and substantiated the key characteristics and capabilities of our system, which include an ultrawide field of view, accurate target positioning, and motion tracking function. We further demonstrate the potential of our unique compound eye for advanced robotic vision by successfully completing a moving target tracking mission.</div>","PeriodicalId":56029,"journal":{"name":"Science Robotics","volume":"9 90","pages":""},"PeriodicalIF":26.1000,"publicationDate":"2024-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.science.org/doi/reader/10.1126/scirobotics.adi8666","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Science Robotics","FirstCategoryId":"94","ListUrlMain":"https://www.science.org/doi/10.1126/scirobotics.adi8666","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Garnering inspiration from biological compound eyes, artificial vision systems boasting a vivid range of diverse visual functional traits have come to the fore recently. However, most of these artificial systems rely on transformable electronics, which suffer from the complexity and constrained geometry of global deformation, as well as potential mismatches between optical and detector units. Here, we present a unique pinhole compound eye that combines a three-dimensionally printed honeycomb optical structure with a hemispherical, all-solid-state, high-density perovskite nanowire photodetector array. The lens-free pinhole structure can be designed and fabricated with an arbitrary layout to match the underlying image sensor. Optical simulations and imaging results matched well with each other and substantiated the key characteristics and capabilities of our system, which include an ultrawide field of view, accurate target positioning, and motion tracking function. We further demonstrate the potential of our unique compound eye for advanced robotic vision by successfully completing a moving target tracking mission.

Abstract Image

使用半球形纳米线阵列的超宽视场针孔复眼,用于机器人视觉。
从生物复眼中汲取灵感,人工视觉系统拥有一系列生动多样的视觉功能特征,近来已崭露头角。然而,这些人工系统大多依赖于可变换电子元件,而电子元件的复杂性和全局变形几何形状的限制,以及光学单元和探测器单元之间潜在的不匹配,都使这些系统受到影响。在这里,我们展示了一种独特的针孔复眼,它将三维打印蜂窝状光学结构与半球形全固态高密度过氧化物纳米线光电探测器阵列结合在一起。无透镜针孔结构可按任意布局设计和制造,以匹配底层图像传感器。光学模拟和成像结果相互吻合,证实了我们系统的关键特性和功能,包括超宽视场、精确目标定位和运动跟踪功能。通过成功完成移动目标跟踪任务,我们进一步证明了我们独特的复眼在先进机器人视觉方面的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Science Robotics
Science Robotics Mathematics-Control and Optimization
CiteScore
30.60
自引率
2.80%
发文量
83
期刊介绍: Science Robotics publishes original, peer-reviewed, science- or engineering-based research articles that advance the field of robotics. The journal also features editor-commissioned Reviews. An international team of academic editors holds Science Robotics articles to the same high-quality standard that is the hallmark of the Science family of journals. Sub-topics include: actuators, advanced materials, artificial Intelligence, autonomous vehicles, bio-inspired design, exoskeletons, fabrication, field robotics, human-robot interaction, humanoids, industrial robotics, kinematics, machine learning, material science, medical technology, motion planning and control, micro- and nano-robotics, multi-robot control, sensors, service robotics, social and ethical issues, soft robotics, and space, planetary and undersea exploration.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信