{"title":"Deep-learning-enabled temporally super-resolved multiplexed fringe projection profilometry: high-speed kHz 3D imaging with low-speed camera","authors":"Wenwu Chen, Shijie Feng, Wei Yin, Yixuan Li, Jiaming Qian, Qian Chen, Chao Zuo","doi":"10.1186/s43074-024-00139-2","DOIUrl":"https://doi.org/10.1186/s43074-024-00139-2","url":null,"abstract":"<p>Recent advances in imaging sensors and digital light projection technology have facilitated rapid progress in 3D optical sensing, enabling 3D surfaces of complex-shaped objects to be captured with high resolution and accuracy. Nevertheless, due to the inherent synchronous pattern projection and image acquisition mechanism, the temporal resolution of conventional structured light or fringe projection profilometry (FPP) based 3D imaging methods is still limited to the native detector frame rates. In this work, we demonstrate a new 3D imaging method, termed deep-learning-enabled multiplexed FPP (DLMFPP), that allows to achieve high-resolution and high-speed 3D imaging at near-one-order of magnitude-higher 3D frame rate with conventional low-speed cameras. By encoding temporal information in one multiplexed fringe pattern, DLMFPP harnesses deep neural networks embedded with Fourier transform, phase-shifting and ensemble learning to decompose the pattern and analyze separate fringes, furnishing a high signal-to-noise ratio and a ready-to-implement solution over conventional computational imaging techniques. We demonstrate this method by measuring different types of transient scenes, including rotating fan blades and bullet fired from a toy gun, at kHz using cameras of around 100 Hz. Experiential results establish that DLMFPP allows slow-scan cameras with their known advantages in terms of cost and spatial resolution to be used for high-speed 3D imaging tasks.</p>","PeriodicalId":93483,"journal":{"name":"PhotoniX","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142208441","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
PhotoniXPub Date : 2024-08-15DOI: 10.1186/s43074-024-00138-3
Lei Zhang, Xinggang Shang, Simin Cao, Qiannan Jia, Jiyong Wang, Wei Yan, Min Qiu
{"title":"Optical steelyard: high-resolution and wide-range refractive index sensing by synergizing Fabry–Perot interferometer with metafibers","authors":"Lei Zhang, Xinggang Shang, Simin Cao, Qiannan Jia, Jiyong Wang, Wei Yan, Min Qiu","doi":"10.1186/s43074-024-00138-3","DOIUrl":"https://doi.org/10.1186/s43074-024-00138-3","url":null,"abstract":"<p>Refractive index (RI) sensors play an important role in various applications including biomedical analysis and food processing industries. However, developing RI sensors with both high resolution and wide linear range remains a great challenge due to the tradeoff between quality (<i>Q</i>) factor and free spectral range (<i>FSR</i>) of resonance mode. Herein, the optical steelyard principle is presented to address this challenge by synergizing resonances from the Fabry–Perot (FP) cavity and metasurface, integrated in a hybrid configuration form on the end facet of optical fibers. Specifically, the FP resonance acting like the scale beam, offers high resolution while the plasmonic resonance acting like the weight, provides a wide linear range. Featuring asymmetric Fano spectrum due to modal coupling between these two resonances, a high <i>Q</i> value (~ 3829 in liquid) and a sensing resolution (figure of merit) of 2664 RIU<sup>−1</sup> are experimentally demonstrated. Meanwhile, a wide RI sensing range (1.330–1.430 in the simulation and 1.3403–1.3757 in the experiment) is realized, corresponding to a spectral shift across several <i>FSR</i>s (four and two <i>FSR</i>s in the simulation and experiment, respectively). The proposed steelyard RI sensing strategy is promising in versatile monitoring applications, e.g., water salinity/turbidity and biomedical reaction process, and could be extended to other types of sensors calling for both high resolution and wide linear range.\u0000</p>","PeriodicalId":93483,"journal":{"name":"PhotoniX","volume":"254 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142208442","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
PhotoniXPub Date : 2024-08-13DOI: 10.1186/s43074-024-00140-9
Duy-Anh Nguyen, Dae Hee Kim, Geon Ho Lee, San Kim, Dong-Chel Shin, Jongkyoon Park, Hak-Jong Choi, Seung-Woo Kim, Seungchul Kim, Young-Jin Kim
{"title":"Real-time monitoring of fast gas dynamics with a single-molecule resolution by frequency-comb-referenced plasmonic phase spectroscopy","authors":"Duy-Anh Nguyen, Dae Hee Kim, Geon Ho Lee, San Kim, Dong-Chel Shin, Jongkyoon Park, Hak-Jong Choi, Seung-Woo Kim, Seungchul Kim, Young-Jin Kim","doi":"10.1186/s43074-024-00140-9","DOIUrl":"https://doi.org/10.1186/s43074-024-00140-9","url":null,"abstract":"<p>Surface plasmon resonance (SPR) sensors are based on photon-excited surface charge density oscillations confined at metal-dielectric interfaces, which makes them highly sensitive to biological or chemical molecular bindings to functional metallic surfaces. Metal nanostructures further concentrate surface plasmons into a smaller area than the diffraction limit, thus strengthening photon-sample interactions. However, plasmonic sensors based on intensity detection provide limited resolution with long acquisition time owing to their high vulnerability to environmental and instrumental noises. Here, we demonstrate fast and precise detection of noble gas dynamics at single molecular resolution via frequency-comb-referenced plasmonic phase spectroscopy. The photon-sample interaction was enhanced by a factor of 3,852 than the physical sample thickness owing to plasmon resonance and thermophoresis-assisted optical confinement effects. By utilizing a sharp plasmonic phase slope and a high heterodyne information carrier, a small atomic-density modulation was clearly resolved at 5 Hz with a resolution of 0.06 Ar atoms per nano-hole (in 10<sup>–11</sup> RIU) in Allan deviation at 0.2 s; a faster motion up to 200 Hz was clearly resolved. This fast and precise sensing technique can enable the in-depth analysis of fast fluid dynamics with the utmost resolution for a better understanding of biomedical, chemical, and physical events and interactions.</p>","PeriodicalId":93483,"journal":{"name":"PhotoniX","volume":"7 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142208444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
PhotoniXPub Date : 2024-06-01DOI: 10.1186/s43074-024-00134-7
Chun Chen, Seung-Woo Nam, Dongyeon Kim, Juhyun Lee, Yoonchan Jeong, Byoungho Lee
{"title":"Ultrahigh-fidelity full-color holographic display via color-aware optimization","authors":"Chun Chen, Seung-Woo Nam, Dongyeon Kim, Juhyun Lee, Yoonchan Jeong, Byoungho Lee","doi":"10.1186/s43074-024-00134-7","DOIUrl":"https://doi.org/10.1186/s43074-024-00134-7","url":null,"abstract":"<p>Holographic display offers the capability to generate high-quality images with a wide color gamut since it is laser-driven. However, many existing holographic display techniques fail to fully exploit this potential, primarily due to the system’s imperfections. Such flaws often result in inaccurate color representation, and there is a lack of an efficient way to address this color accuracy issue. In this study, we develop a color-aware hologram optimization approach for color-accurate holographic displays. Our approach integrates both laser and camera into the hologram optimization loop, enabling dynamic optimization of the laser’s output color and the acquisition of physically captured feedback. Moreover, we improve the efficiency of the color-aware optimization process for holographic video displays. We introduce a cascade optimization strategy, which leverages the redundant neighbor hologram information to accelerate the iterative process. We evaluate our method through both simulation and optical experiments, demonstrating the superiority in terms of image quality, color accuracy, and hologram optimization speed compared to previous algorithms. Our approach verifies a promising way to realize a high-fidelity image in the holographic display, which provides a new direction toward the practical holographic display.</p>","PeriodicalId":93483,"journal":{"name":"PhotoniX","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141196669","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
PhotoniXPub Date : 2024-05-14DOI: 10.1186/s43074-024-00133-8
Jiawei Sun, Robert Kuschmierz, Ori Katz, Nektarios Koukourakis, Juergen W. Czarske
{"title":"Lensless fiber endomicroscopy in biomedicine","authors":"Jiawei Sun, Robert Kuschmierz, Ori Katz, Nektarios Koukourakis, Juergen W. Czarske","doi":"10.1186/s43074-024-00133-8","DOIUrl":"https://doi.org/10.1186/s43074-024-00133-8","url":null,"abstract":"<p>Lensless fiber endomicroscopy, an emergent paradigm shift for minimally-invasive microscopic optical imaging and targeted light delivery, holds transformative potential, especially in biomedicine. Leveraging holographic detection and physical or computational wavefront correction, it enables three-dimensional imaging in an unprecedentedly small footprint, which is crucial for various applications such as brain surgery. This perspective reviews the recent breakthroughs, highlighting potential emerging applications, and pinpointing gaps between innovation and real-world applications. As the research in this realm accelerates, the novel breakthroughs and existing frontiers highlighted in this perspective can be used as guidelines for researchers joining this exciting domain.</p>","PeriodicalId":93483,"journal":{"name":"PhotoniX","volume":"115 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140937117","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
PhotoniXPub Date : 2024-05-01DOI: 10.1186/s43074-024-00118-7
Changhui Rao, Libo Zhong, Youming Guo, Min Li, Lanqiang Zhang, Kai Wei
{"title":"Astronomical adaptive optics: a review","authors":"Changhui Rao, Libo Zhong, Youming Guo, Min Li, Lanqiang Zhang, Kai Wei","doi":"10.1186/s43074-024-00118-7","DOIUrl":"https://doi.org/10.1186/s43074-024-00118-7","url":null,"abstract":"<p>Since the concept of adaptive optics(AO) was proposed in 1953, AO has become an indispensable technology for large aperture ground-based optical telescopes aimed at high resolution observations. This paper provides a comprehensive review of AO progress for large aperture astronomical optical telescopes including both night-time and day-time solar optical telescopes. The recent AO technological advances, such as Laser Guide Star, Deformable Secondary Mirror, Extreme AO, and Multi-Conjugate AO are focused.</p>","PeriodicalId":93483,"journal":{"name":"PhotoniX","volume":"16 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140840635","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Large-scale optical switches by thermo-optic waveguide lens","authors":"Tao Chen, Zhangqi Dang, Zeyu Deng, Shijie Ke, Zhenming Ding, Ziyang Zhang","doi":"10.1186/s43074-024-00131-w","DOIUrl":"https://doi.org/10.1186/s43074-024-00131-w","url":null,"abstract":"Optical switches are desired in telecom and datacom as an upgrade to electrical ones for lower power consumption and expenses while improving bandwidth and network transparency. Compact, integrated optical switches are attractive thanks to their scalability, readiness for mass production, and robustness against mechanical disturbances. The basic unit relies mostly on a microring resonator or a Mach–Zehnder interferometer for binary “bar” and “cross” switching. Such single-mode structures are often wavelength / polarization dependent, sensitive to phase errors and loss-prone. Furthermore, when they are cascaded to a network, the number of control units grows quickly with the port count, causing high complexity in electronic wiring and drive circuit integration. Herein, we propose a new switching method by thermo-optic waveguide lens. Essentially, this multimode waveguide forms a square law medium by a pair of heater electrodes and focuses light within a chip by robust 1 × 1 imaging. A 1 × 24 basic switch is demonstrated with 32 electrodes and only two are biased at a time for a chosen output. By two-level cascading, the switch expands to 576 ports and only four electrodes are needed for one path. The chips are fabricated on wafer scale in a low-budget laboratory without resorting to foundries. Yet, the performance goes beyond state of the art for low insertion loss, low wavelength dependence and low polarization dependence. This work provides an original, alternative, and practical route to construct large-scale optical switches, enabling broad applications in telecom, datacom and photonic computing.","PeriodicalId":93483,"journal":{"name":"PhotoniX","volume":"6 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140611525","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
PhotoniXPub Date : 2024-04-17DOI: 10.1186/s43074-024-00125-8
Jitao Ji, Chen Chen, Jiacheng Sun, Xin Ye, Zhizhang Wang, Jian Li, Junyi Wang, Wange Song, Chunyu Huang, Kai Qiu, Shining Zhu, Tao Li
{"title":"High-dimensional Poincaré beams generated through cascaded metasurfaces for high-security optical encryption","authors":"Jitao Ji, Chen Chen, Jiacheng Sun, Xin Ye, Zhizhang Wang, Jian Li, Junyi Wang, Wange Song, Chunyu Huang, Kai Qiu, Shining Zhu, Tao Li","doi":"10.1186/s43074-024-00125-8","DOIUrl":"https://doi.org/10.1186/s43074-024-00125-8","url":null,"abstract":"<p>Optical encryption plays an increasingly important role in the field of information security owing to its parallel processing capability and low power consumption. Employing the ultrathin metasurfaces in optical encryption has promoted the miniaturization and multifunctionality of encryption systems. Nevertheless, with the few number of degrees of freedom (DoFs) multiplexed by single metasurface, both key space and encoding space are limited. To address this issue, we propose a high-security and large-capacity optical encryption scheme based on perfect high-dimensional Poincaré beams with expanded DoFs. By cascading two arrayed metasurfaces, more beam properties can be independently engineered, which gives rise to the extensively expanded key and encoding spaces. Our work provides a promising strategy for optical encryption with high security level and large information capacity and might facilitate the applications of Poincaré beams in optical communications and quantum information.</p>","PeriodicalId":93483,"journal":{"name":"PhotoniX","volume":"48 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140611247","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
PhotoniXPub Date : 2024-04-16DOI: 10.1186/s43074-024-00127-6
Suyi Zhong, Liang Qiao, Xichuan Ge, Xinzhu Xu, Yuzhe Fu, Shu Gao, Karl Zhanghao, Huiwen Hao, Wenyi Wang, Meiqi Li, Peng Xi
{"title":"Three-dimensional dipole orientation mapping with high temporal-spatial resolution using polarization modulation","authors":"Suyi Zhong, Liang Qiao, Xichuan Ge, Xinzhu Xu, Yuzhe Fu, Shu Gao, Karl Zhanghao, Huiwen Hao, Wenyi Wang, Meiqi Li, Peng Xi","doi":"10.1186/s43074-024-00127-6","DOIUrl":"https://doi.org/10.1186/s43074-024-00127-6","url":null,"abstract":"Fluorescence polarization microscopy is widely used in biology for molecular orientation properties. However, due to the limited temporal resolution of single-molecule orientation localization microscopy and the limited orientation dimension of polarization modulation techniques, achieving simultaneous high temporal-spatial resolution mapping of the three-dimensional (3D) orientation of fluorescent dipoles remains an outstanding problem. Here, we present a super-resolution 3D orientation mapping (3DOM) microscope that resolves 3D orientation by extracting phase information of the six polarization modulation components in reciprocal space. 3DOM achieves an azimuthal precision of 2° and a polar precision of 3° with spatial resolution of up to 128 nm in the experiments. We validate that 3DOM not only reveals the heterogeneity of the milk fat globule membrane, but also elucidates the 3D structure of biological filaments, including the 3D spatial conformation of λ-DNA and the structural disorder of actin filaments. Furthermore, 3DOM images the dipole dynamics of microtubules labeled with green fluorescent protein in live U2OS cells, reporting dynamic 3D orientation variations. Given its easy integration into existing wide-field microscopes, we expect the 3DOM microscope to provide a multi-view versatile strategy for investigating molecular structure and dynamics in biological macromolecules across multiple spatial and temporal scales.","PeriodicalId":93483,"journal":{"name":"PhotoniX","volume":"68 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140603412","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Ultra-wideband terahertz fingerprint enhancement sensing and inversion model supported by single-pixel reconfigurable graphene metasurface","authors":"Bingwei Liu, Yan Peng, YuFan Hao, Yiming Zhu, Shengjiang Chang, Songlin Zhuang","doi":"10.1186/s43074-024-00129-4","DOIUrl":"https://doi.org/10.1186/s43074-024-00129-4","url":null,"abstract":"<p>The molecular fingerprint sensing technology based on metasurface has unique attraction in the biomedical field. However, in the terahertz (THz) band, existing metasurface designs based on multi-pixel or angle multiplexing usually require more analyte amount or possess a narrower tuning bandwidth. Here, we propose a novel single-pixel graphene metasurface. Based on the synchronous voltage tuning, this metasurface enables ultra-wideband (<span>(sim)</span> 1.5 THz) fingerprint enhancement sensing of trace analytes, including chiral optical isomers, with a limit of detection (LoD) ≤ 0.64 μg/mm<sup>2</sup>. The enhancement of the fingerprint signal (<span>(sim)</span> 17.4 dB) originates from the electromagnetically induced transparency (EIT) effect excited by the metasurface, and the ideal overlap between the light field constrained by single-layer graphene (SLG) and ultra-thin analyte. Meanwhile, due to the unique nonlinear enhancement mechanism in graphene tuning, the absorption envelope distortion is inevitable. To solve this problem, a universal fingerprint spectrum inversion model is developed for the first time, and the restoration of standard fingerprints reaches R<sub>max</sub><sup>2</sup> ≥ 0.99. In addition, the asynchronous voltage tuning of the metasurface provides an opportunity for realizing the dynamic reconfiguration of EIT resonance and the slow light modulation in the broadband range. This work builds a bridge for ultra-wideband THz fingerprint sensing of trace analytes, and has potential applications in active spatial light modulators, slow light devices and dynamic imaging equipments.</p>","PeriodicalId":93483,"journal":{"name":"PhotoniX","volume":"6 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140582007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}