基于多重先验深度展开网络的单像素智能识别

IF 2.1 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC
Quan Zou;Qiurong Yan;Qianling Dai;Ao Wang;Bo Yang;Yi Li;Jinwei Yan
{"title":"基于多重先验深度展开网络的单像素智能识别","authors":"Quan Zou;Qiurong Yan;Qianling Dai;Ao Wang;Bo Yang;Yi Li;Jinwei Yan","doi":"10.1109/JPHOT.2024.3420787","DOIUrl":null,"url":null,"abstract":"Single-pixel imaging (SPI), an imaging technique based on the theory of compressed sensing, is limited in real-time imaging and high-resolution images due to its relatively slow imaging speed. In recent years, deep unfolding network compressed sensing reconstruction algorithms based on deep learning have proven to be an effective solution for faster and higher quality image reconstruction. However, existing deep unfolding networks mainly rely on a single piece of a priori information and may ignore other intrinsic structures of the image. Therefore, in this paper, we propose a deep unfolding network (MPDU-Net) that incorporates multiple prior information. To effectively fuse multiple prior information, we propose three different fusion strategies in the deep reconstruction sub-network. An unbiased convolutional layer is used to simulate the sampling reconstruction process to achieve joint reconstruction for effective removal of block artifacts. The sampling matrix is input into the deep reconstruction sub-network as a learnable parameter to achieve joint optimization of sampling reconstruction. Simulation and practical experimental results show that the proposed network outperforms existing compressed sensing reconstruction algorithms based on deep unfolding networks.","PeriodicalId":13204,"journal":{"name":"IEEE Photonics Journal","volume":"16 4","pages":"1-10"},"PeriodicalIF":2.1000,"publicationDate":"2024-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10577085","citationCount":"0","resultStr":"{\"title\":\"Single Pixel Imaging Based on Multiple Prior Deep Unfolding Network\",\"authors\":\"Quan Zou;Qiurong Yan;Qianling Dai;Ao Wang;Bo Yang;Yi Li;Jinwei Yan\",\"doi\":\"10.1109/JPHOT.2024.3420787\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Single-pixel imaging (SPI), an imaging technique based on the theory of compressed sensing, is limited in real-time imaging and high-resolution images due to its relatively slow imaging speed. In recent years, deep unfolding network compressed sensing reconstruction algorithms based on deep learning have proven to be an effective solution for faster and higher quality image reconstruction. However, existing deep unfolding networks mainly rely on a single piece of a priori information and may ignore other intrinsic structures of the image. Therefore, in this paper, we propose a deep unfolding network (MPDU-Net) that incorporates multiple prior information. To effectively fuse multiple prior information, we propose three different fusion strategies in the deep reconstruction sub-network. An unbiased convolutional layer is used to simulate the sampling reconstruction process to achieve joint reconstruction for effective removal of block artifacts. The sampling matrix is input into the deep reconstruction sub-network as a learnable parameter to achieve joint optimization of sampling reconstruction. Simulation and practical experimental results show that the proposed network outperforms existing compressed sensing reconstruction algorithms based on deep unfolding networks.\",\"PeriodicalId\":13204,\"journal\":{\"name\":\"IEEE Photonics Journal\",\"volume\":\"16 4\",\"pages\":\"1-10\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-06-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10577085\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Photonics Journal\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10577085/\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Photonics Journal","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10577085/","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

单像素成像(SPI)是一种基于压缩传感理论的成像技术,由于其成像速度相对较慢,在实时成像和高分辨率图像方面受到限制。近年来,基于深度学习的深度展开网络压缩传感重建算法已被证明是更快、更高质量图像重建的有效解决方案。然而,现有的深度展开网络主要依赖于单一的先验信息,可能会忽略图像的其他内在结构。因此,我们在本文中提出了一种融合多种先验信息的深度展开网络(MPDU-Net)。为了有效融合多种先验信息,我们在深度重构子网络中提出了三种不同的融合策略。无偏卷积层用于模拟采样重建过程,以实现联合重建,有效去除块状伪影。采样矩阵作为可学习参数被输入深度重构子网络,以实现采样重构的联合优化。仿真和实际实验结果表明,所提出的网络优于现有的基于深度展开网络的压缩传感重建算法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Single Pixel Imaging Based on Multiple Prior Deep Unfolding Network
Single-pixel imaging (SPI), an imaging technique based on the theory of compressed sensing, is limited in real-time imaging and high-resolution images due to its relatively slow imaging speed. In recent years, deep unfolding network compressed sensing reconstruction algorithms based on deep learning have proven to be an effective solution for faster and higher quality image reconstruction. However, existing deep unfolding networks mainly rely on a single piece of a priori information and may ignore other intrinsic structures of the image. Therefore, in this paper, we propose a deep unfolding network (MPDU-Net) that incorporates multiple prior information. To effectively fuse multiple prior information, we propose three different fusion strategies in the deep reconstruction sub-network. An unbiased convolutional layer is used to simulate the sampling reconstruction process to achieve joint reconstruction for effective removal of block artifacts. The sampling matrix is input into the deep reconstruction sub-network as a learnable parameter to achieve joint optimization of sampling reconstruction. Simulation and practical experimental results show that the proposed network outperforms existing compressed sensing reconstruction algorithms based on deep unfolding networks.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Photonics Journal
IEEE Photonics Journal ENGINEERING, ELECTRICAL & ELECTRONIC-OPTICS
CiteScore
4.50
自引率
8.30%
发文量
489
审稿时长
1.4 months
期刊介绍: Breakthroughs in the generation of light and in its control and utilization have given rise to the field of Photonics, a rapidly expanding area of science and technology with major technological and economic impact. Photonics integrates quantum electronics and optics to accelerate progress in the generation of novel photon sources and in their utilization in emerging applications at the micro and nano scales spanning from the far-infrared/THz to the x-ray region of the electromagnetic spectrum. IEEE Photonics Journal is an online-only journal dedicated to the rapid disclosure of top-quality peer-reviewed research at the forefront of all areas of photonics. Contributions addressing issues ranging from fundamental understanding to emerging technologies and applications are within the scope of the Journal. The Journal includes topics in: Photon sources from far infrared to X-rays, Photonics materials and engineered photonic structures, Integrated optics and optoelectronic, Ultrafast, attosecond, high field and short wavelength photonics, Biophotonics, including DNA photonics, Nanophotonics, Magnetophotonics, Fundamentals of light propagation and interaction; nonlinear effects, Optical data storage, Fiber optics and optical communications devices, systems, and technologies, Micro Opto Electro Mechanical Systems (MOEMS), Microwave photonics, Optical Sensors.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信