Jianze Ye , Xuejuan Hu , Lingling Chen , Yuejie Huang , Hengliang Wang , Jian Zou , Zihao Cheng , Qianding Gao , Jingli Zhong , Shiqian Liu , Minfei Li
{"title":"UT-SIM:一种基于变压器的结构照明显微镜超分辨率重建特征融合网络","authors":"Jianze Ye , Xuejuan Hu , Lingling Chen , Yuejie Huang , Hengliang Wang , Jian Zou , Zihao Cheng , Qianding Gao , Jingli Zhong , Shiqian Liu , Minfei Li","doi":"10.1016/j.optlastec.2025.113551","DOIUrl":null,"url":null,"abstract":"<div><div>We propose UT-SIM, a novel deep learning framework that integrates transformer-based feature fusion into a U-Net architecture for super-resolution reconstruction in structured illumination microscopy (SIM). To further enhance reconstruction performance, UT-SIM incorporates Channel and Spatial Attention Modules (CSAM), which dynamically reweight feature maps across multiple scales. This attention mechanism enables the model to focus more effectively on critical spatial and channel-level information. Compared with conventional networks such as SRCNN, U-Net, and ML-SIM, UT-SIM achieves significant improvements in image quality, with structural similarity index (SSIM) gains of approximately 0.3–0.6 and peak signal-to-noise ratio (PSNR) improvements of 1–2 dB. Additionally, we propose a synthetic dataset generation method that enables the creation of tailored datasets for various SIM systems. Models trained with this simulated data demonstrate robust transfer learning capabilities, delivering high-quality reconstructions across diverse SIM platforms.</div></div>","PeriodicalId":19511,"journal":{"name":"Optics and Laser Technology","volume":"192 ","pages":"Article 113551"},"PeriodicalIF":5.0000,"publicationDate":"2025-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"UT-SIM: A transformer-based feature fusion network for super-resolution reconstruction in structured illumination microscopy\",\"authors\":\"Jianze Ye , Xuejuan Hu , Lingling Chen , Yuejie Huang , Hengliang Wang , Jian Zou , Zihao Cheng , Qianding Gao , Jingli Zhong , Shiqian Liu , Minfei Li\",\"doi\":\"10.1016/j.optlastec.2025.113551\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>We propose UT-SIM, a novel deep learning framework that integrates transformer-based feature fusion into a U-Net architecture for super-resolution reconstruction in structured illumination microscopy (SIM). To further enhance reconstruction performance, UT-SIM incorporates Channel and Spatial Attention Modules (CSAM), which dynamically reweight feature maps across multiple scales. This attention mechanism enables the model to focus more effectively on critical spatial and channel-level information. Compared with conventional networks such as SRCNN, U-Net, and ML-SIM, UT-SIM achieves significant improvements in image quality, with structural similarity index (SSIM) gains of approximately 0.3–0.6 and peak signal-to-noise ratio (PSNR) improvements of 1–2 dB. Additionally, we propose a synthetic dataset generation method that enables the creation of tailored datasets for various SIM systems. Models trained with this simulated data demonstrate robust transfer learning capabilities, delivering high-quality reconstructions across diverse SIM platforms.</div></div>\",\"PeriodicalId\":19511,\"journal\":{\"name\":\"Optics and Laser Technology\",\"volume\":\"192 \",\"pages\":\"Article 113551\"},\"PeriodicalIF\":5.0000,\"publicationDate\":\"2025-07-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Optics and Laser Technology\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0030399225011429\",\"RegionNum\":2,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"OPTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics and Laser Technology","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0030399225011429","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPTICS","Score":null,"Total":0}
UT-SIM: A transformer-based feature fusion network for super-resolution reconstruction in structured illumination microscopy
We propose UT-SIM, a novel deep learning framework that integrates transformer-based feature fusion into a U-Net architecture for super-resolution reconstruction in structured illumination microscopy (SIM). To further enhance reconstruction performance, UT-SIM incorporates Channel and Spatial Attention Modules (CSAM), which dynamically reweight feature maps across multiple scales. This attention mechanism enables the model to focus more effectively on critical spatial and channel-level information. Compared with conventional networks such as SRCNN, U-Net, and ML-SIM, UT-SIM achieves significant improvements in image quality, with structural similarity index (SSIM) gains of approximately 0.3–0.6 and peak signal-to-noise ratio (PSNR) improvements of 1–2 dB. Additionally, we propose a synthetic dataset generation method that enables the creation of tailored datasets for various SIM systems. Models trained with this simulated data demonstrate robust transfer learning capabilities, delivering high-quality reconstructions across diverse SIM platforms.
期刊介绍:
Optics & Laser Technology aims to provide a vehicle for the publication of a broad range of high quality research and review papers in those fields of scientific and engineering research appertaining to the development and application of the technology of optics and lasers. Papers describing original work in these areas are submitted to rigorous refereeing prior to acceptance for publication.
The scope of Optics & Laser Technology encompasses, but is not restricted to, the following areas:
•development in all types of lasers
•developments in optoelectronic devices and photonics
•developments in new photonics and optical concepts
•developments in conventional optics, optical instruments and components
•techniques of optical metrology, including interferometry and optical fibre sensors
•LIDAR and other non-contact optical measurement techniques, including optical methods in heat and fluid flow
•applications of lasers to materials processing, optical NDT display (including holography) and optical communication
•research and development in the field of laser safety including studies of hazards resulting from the applications of lasers (laser safety, hazards of laser fume)
•developments in optical computing and optical information processing
•developments in new optical materials
•developments in new optical characterization methods and techniques
•developments in quantum optics
•developments in light assisted micro and nanofabrication methods and techniques
•developments in nanophotonics and biophotonics
•developments in imaging processing and systems