Miniaturized Spectroscopy Based on Lens-Free Speckle Image Encoding

IF 6.7 1区 物理与天体物理 Q1 MATERIALS SCIENCE, MULTIDISCIPLINARY
Tianbiao Zhou, Siyuan Huang, Qilin Zheng, Mengting Gao, Yongyue Huang, Ziwang Tuo, Long Wen, Qin Chen
{"title":"Miniaturized Spectroscopy Based on Lens-Free Speckle Image Encoding","authors":"Tianbiao Zhou, Siyuan Huang, Qilin Zheng, Mengting Gao, Yongyue Huang, Ziwang Tuo, Long Wen, Qin Chen","doi":"10.1021/acsphotonics.4c00636","DOIUrl":null,"url":null,"abstract":"Miniaturized spectroscopy has attracted extensive interest recently due to its advantages of high integration and low cost. Image encoding is an emerging and promising technique to connect in-plane field distributions and spectral components, considering its perfect match with mature image sensors in portable platforms. Usually, an object lens and a large working distance are required to resolve the wavelength-dependent images encoded by light dispersion nanostructures, which inevitably increase the complexity for optical alignment and the system footprint. Here, a lens-free speckle image encoding technique was developed for computational spectroscopy by integrating disordered gold nanorods onto a CMOS image sensor with an entire thickness of less than 2 mm. A convolutional neural network (CNN) algorithm was applied to decode the image-spectrum relation by classifying the images with a multilayer perceptron to extract high-level features, overcoming the high correlations of the encoded images in such a compact configuration. Accurate spectral reconstruction was demonstrated with a peak wavelength deviation of less than 1 nm. Furthermore, the required CNN training data set scale or training time was found to be greatly reduced by simply embedding metallic micro holes between the nanorods and the image sensor due to the remarkably improved image quality via the pinhole imaging principle. It is expected that such a compact and low-cost miniaturized spectroscopy platform with decent spectral sensing accuracy enhanced by the deep-learning technique demonstrates important application prospects for on-site inspection and a distributed sensor network.","PeriodicalId":23,"journal":{"name":"ACS Photonics","volume":"200 1","pages":""},"PeriodicalIF":6.7000,"publicationDate":"2024-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Photonics","FirstCategoryId":"101","ListUrlMain":"https://doi.org/10.1021/acsphotonics.4c00636","RegionNum":1,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATERIALS SCIENCE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

Miniaturized spectroscopy has attracted extensive interest recently due to its advantages of high integration and low cost. Image encoding is an emerging and promising technique to connect in-plane field distributions and spectral components, considering its perfect match with mature image sensors in portable platforms. Usually, an object lens and a large working distance are required to resolve the wavelength-dependent images encoded by light dispersion nanostructures, which inevitably increase the complexity for optical alignment and the system footprint. Here, a lens-free speckle image encoding technique was developed for computational spectroscopy by integrating disordered gold nanorods onto a CMOS image sensor with an entire thickness of less than 2 mm. A convolutional neural network (CNN) algorithm was applied to decode the image-spectrum relation by classifying the images with a multilayer perceptron to extract high-level features, overcoming the high correlations of the encoded images in such a compact configuration. Accurate spectral reconstruction was demonstrated with a peak wavelength deviation of less than 1 nm. Furthermore, the required CNN training data set scale or training time was found to be greatly reduced by simply embedding metallic micro holes between the nanorods and the image sensor due to the remarkably improved image quality via the pinhole imaging principle. It is expected that such a compact and low-cost miniaturized spectroscopy platform with decent spectral sensing accuracy enhanced by the deep-learning technique demonstrates important application prospects for on-site inspection and a distributed sensor network.

Abstract Image

基于无透镜斑点图像编码的微型光谱仪
微型光谱仪因其高集成度和低成本的优势最近引起了广泛关注。考虑到图像编码与便携式平台中成熟的图像传感器的完美匹配,图像编码是连接平面场分布和光谱成分的一种新兴且前景广阔的技术。通常,要分辨由光色散纳米结构编码的波长相关图像,需要使用物镜和较大的工作距离,这不可避免地增加了光学对准的复杂性和系统占用空间。在这里,通过将无序金纳米棒集成到整个厚度小于 2 毫米的 CMOS 图像传感器上,为计算光谱学开发了一种无透镜斑点图像编码技术。卷积神经网络(CNN)算法通过多层感知器对图像进行分类,提取高层次特征,克服了在如此紧凑的结构中编码图像的高相关性,从而对图像-光谱关系进行解码。精确的光谱重建得到了证实,峰值波长偏差小于 1 nm。此外,由于针孔成像原理显著提高了图像质量,在纳米棒和图像传感器之间嵌入金属微孔可大大减少所需的 CNN 训练数据集规模或训练时间。这种结构紧凑、成本低廉的微型光谱分析平台通过深度学习技术提高了光谱传感精度,有望在现场检测和分布式传感器网络中展现出重要的应用前景。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
ACS Photonics
ACS Photonics NANOSCIENCE & NANOTECHNOLOGY-MATERIALS SCIENCE, MULTIDISCIPLINARY
CiteScore
11.90
自引率
5.70%
发文量
438
审稿时长
2.3 months
期刊介绍: Published as soon as accepted and summarized in monthly issues, ACS Photonics will publish Research Articles, Letters, Perspectives, and Reviews, to encompass the full scope of published research in this field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信