{"title":"All-optical image transportation through a multimode fibre using a miniaturized diffractive neural network on the distal facet","authors":"Haoyi Yu, Zihao Huang, Simone Lamon, Baokai Wang, Haibo Ding, Jian Lin, Qi Wang, Haitao Luan, Min Gu, Qiming Zhang","doi":"10.1038/s41566-025-01621-4","DOIUrl":null,"url":null,"abstract":"<p>The direct optical transportation of images through multimode fibres (MMFs) is highly sought after in compact photonic systems for MMF-based optical information processing. However, MMFs are highly scattering media, thus degrading information transmitted through them. Existing approaches utilize artificial neural networks or spatial light modulators to reconstruct images scrambled after propagation through the fibre. Despite these advances, achieving direct optical image transportation through MMFs using integrated optical elements with micrometre-scale footprints remains challenging. Here we develop a miniaturized diffractive neural network (DN<sub>2</sub>s) integrated on the distal facet of a MMF for the direct all-optical image transportation through the fibre. The DN<sub>2</sub>s has a footprint of 150 μm by 150 μm and is fabricated on the facet of a 0.35-m-long MMF using three-dimensional two-photon nanolithography. The fibre-integrated DN<sub>2</sub>s enables single-shot optical transportation of images with flat phases in real time for a constant configuration of the MMF. The system achieves a minimum image reconstruction feature size of approximately 4.90 μm over a field of view 65 μm by 65 μm when imaging handwritten digits. Transfer learning is also demonstrated by the direct optical transportation of HeLa cell images projected by spatial light modulators, which were not part of the training dataset. The concept and implementation pave the way to the integration of miniaturized DN<sub>2</sub>s with MMFs for compact photonic systems with unprecedented functionalities.</p>","PeriodicalId":18926,"journal":{"name":"Nature Photonics","volume":"140 1","pages":""},"PeriodicalIF":32.3000,"publicationDate":"2025-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nature Photonics","FirstCategoryId":"101","ListUrlMain":"https://doi.org/10.1038/s41566-025-01621-4","RegionNum":1,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0
Abstract
The direct optical transportation of images through multimode fibres (MMFs) is highly sought after in compact photonic systems for MMF-based optical information processing. However, MMFs are highly scattering media, thus degrading information transmitted through them. Existing approaches utilize artificial neural networks or spatial light modulators to reconstruct images scrambled after propagation through the fibre. Despite these advances, achieving direct optical image transportation through MMFs using integrated optical elements with micrometre-scale footprints remains challenging. Here we develop a miniaturized diffractive neural network (DN2s) integrated on the distal facet of a MMF for the direct all-optical image transportation through the fibre. The DN2s has a footprint of 150 μm by 150 μm and is fabricated on the facet of a 0.35-m-long MMF using three-dimensional two-photon nanolithography. The fibre-integrated DN2s enables single-shot optical transportation of images with flat phases in real time for a constant configuration of the MMF. The system achieves a minimum image reconstruction feature size of approximately 4.90 μm over a field of view 65 μm by 65 μm when imaging handwritten digits. Transfer learning is also demonstrated by the direct optical transportation of HeLa cell images projected by spatial light modulators, which were not part of the training dataset. The concept and implementation pave the way to the integration of miniaturized DN2s with MMFs for compact photonic systems with unprecedented functionalities.
期刊介绍:
Nature Photonics is a monthly journal dedicated to the scientific study and application of light, known as Photonics. It publishes top-quality, peer-reviewed research across all areas of light generation, manipulation, and detection.
The journal encompasses research into the fundamental properties of light and its interactions with matter, as well as the latest developments in optoelectronic devices and emerging photonics applications. Topics covered include lasers, LEDs, imaging, detectors, optoelectronic devices, quantum optics, biophotonics, optical data storage, spectroscopy, fiber optics, solar energy, displays, terahertz technology, nonlinear optics, plasmonics, nanophotonics, and X-rays.
In addition to research papers and review articles summarizing scientific findings in optoelectronics, Nature Photonics also features News and Views pieces and research highlights. It uniquely includes articles on the business aspects of the industry, such as technology commercialization and market analysis, offering a comprehensive perspective on the field.