Mingyang Chen , Jiyue Wang , Mengge Liu , Ziqin Xu , Hao Liu , Mingliang Xu
{"title":"基于光传输矩阵分解的被动非视线行人成像","authors":"Mingyang Chen , Jiyue Wang , Mengge Liu , Ziqin Xu , Hao Liu , Mingliang Xu","doi":"10.1016/j.optlaseng.2025.109032","DOIUrl":null,"url":null,"abstract":"<div><div>Passive non-line-of-sight (NLOS) imaging extends the observer's perceptual range, offering promising applications in fields such as autonomous driving and emergency rescue. However, mainstream passive NLOS imaging methods are generally limited to distances of less than 6 meters and often rely on a single simulated light transmission matrix, overlooking brightness and reflection characteristics. To overcome these limitations, we employ an infrared camera to capture relayed signals from long distances and introduce the NLOS Pedestrian Imaging Algorithm based on Light Transport Matrix Decomposition (NLOS-LTMD). This innovative algorithm simulates the light transport matrix in two parts: an illumination transport matrix for reconstructing brightness and a reflection transport matrix for enhancing contours. In addition, we propose an Illumination-Oriented Transformer (IO-Transformer) that utilizes threshold segmentation to identify the most informative regions based on the intensity of illumination information addressing the issue of introducing noise and low-SNR regions during contextual modeling, which can degrade imaging quality. Quantitative and qualitative experiments demonstrate that NLOS-LTMD markedly surpasses existing methods in both robustness and reconstruction quality.</div></div>","PeriodicalId":49719,"journal":{"name":"Optics and Lasers in Engineering","volume":"192 ","pages":"Article 109032"},"PeriodicalIF":3.5000,"publicationDate":"2025-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Passive non-line-of-sight pedestrian imaging based on light transport matrix decomposition\",\"authors\":\"Mingyang Chen , Jiyue Wang , Mengge Liu , Ziqin Xu , Hao Liu , Mingliang Xu\",\"doi\":\"10.1016/j.optlaseng.2025.109032\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Passive non-line-of-sight (NLOS) imaging extends the observer's perceptual range, offering promising applications in fields such as autonomous driving and emergency rescue. However, mainstream passive NLOS imaging methods are generally limited to distances of less than 6 meters and often rely on a single simulated light transmission matrix, overlooking brightness and reflection characteristics. To overcome these limitations, we employ an infrared camera to capture relayed signals from long distances and introduce the NLOS Pedestrian Imaging Algorithm based on Light Transport Matrix Decomposition (NLOS-LTMD). This innovative algorithm simulates the light transport matrix in two parts: an illumination transport matrix for reconstructing brightness and a reflection transport matrix for enhancing contours. In addition, we propose an Illumination-Oriented Transformer (IO-Transformer) that utilizes threshold segmentation to identify the most informative regions based on the intensity of illumination information addressing the issue of introducing noise and low-SNR regions during contextual modeling, which can degrade imaging quality. Quantitative and qualitative experiments demonstrate that NLOS-LTMD markedly surpasses existing methods in both robustness and reconstruction quality.</div></div>\",\"PeriodicalId\":49719,\"journal\":{\"name\":\"Optics and Lasers in Engineering\",\"volume\":\"192 \",\"pages\":\"Article 109032\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2025-04-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Optics and Lasers in Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0143816625002180\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OPTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics and Lasers in Engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0143816625002180","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
Passive non-line-of-sight pedestrian imaging based on light transport matrix decomposition
Passive non-line-of-sight (NLOS) imaging extends the observer's perceptual range, offering promising applications in fields such as autonomous driving and emergency rescue. However, mainstream passive NLOS imaging methods are generally limited to distances of less than 6 meters and often rely on a single simulated light transmission matrix, overlooking brightness and reflection characteristics. To overcome these limitations, we employ an infrared camera to capture relayed signals from long distances and introduce the NLOS Pedestrian Imaging Algorithm based on Light Transport Matrix Decomposition (NLOS-LTMD). This innovative algorithm simulates the light transport matrix in two parts: an illumination transport matrix for reconstructing brightness and a reflection transport matrix for enhancing contours. In addition, we propose an Illumination-Oriented Transformer (IO-Transformer) that utilizes threshold segmentation to identify the most informative regions based on the intensity of illumination information addressing the issue of introducing noise and low-SNR regions during contextual modeling, which can degrade imaging quality. Quantitative and qualitative experiments demonstrate that NLOS-LTMD markedly surpasses existing methods in both robustness and reconstruction quality.
期刊介绍:
Optics and Lasers in Engineering aims at providing an international forum for the interchange of information on the development of optical techniques and laser technology in engineering. Emphasis is placed on contributions targeted at the practical use of methods and devices, the development and enhancement of solutions and new theoretical concepts for experimental methods.
Optics and Lasers in Engineering reflects the main areas in which optical methods are being used and developed for an engineering environment. Manuscripts should offer clear evidence of novelty and significance. Papers focusing on parameter optimization or computational issues are not suitable. Similarly, papers focussed on an application rather than the optical method fall outside the journal''s scope. The scope of the journal is defined to include the following:
-Optical Metrology-
Optical Methods for 3D visualization and virtual engineering-
Optical Techniques for Microsystems-
Imaging, Microscopy and Adaptive Optics-
Computational Imaging-
Laser methods in manufacturing-
Integrated optical and photonic sensors-
Optics and Photonics in Life Science-
Hyperspectral and spectroscopic methods-
Infrared and Terahertz techniques