无监督共聚焦浅眼睑图像拼接:灵活、准确、流畅

IF 4.9 2区 医学 Q1 ENGINEERING, BIOMEDICAL
Lei Huo , Lei Qin , Shengyu Wu , Ming Li , Wei Yan , Long Chang , Shengli Mi
{"title":"无监督共聚焦浅眼睑图像拼接:灵活、准确、流畅","authors":"Lei Huo ,&nbsp;Lei Qin ,&nbsp;Shengyu Wu ,&nbsp;Ming Li ,&nbsp;Wei Yan ,&nbsp;Long Chang ,&nbsp;Shengli Mi","doi":"10.1016/j.bspc.2025.108760","DOIUrl":null,"url":null,"abstract":"<div><div>Confocal laser scanning microscope enables non-invasive ocular Demodex screening but faces field-of-view (FOV) limitations. Although image stitching can theoretically expand FOV, traditional methods only achieve approximately 60% success rate due to low illumination, weak textures and repetitive patterns. To address these challenges, we propose an unsupervised deep learning-based image stitching framework with dual-stage alignment and generative adversarial network (GAN)-based fusion. Our dual-stage alignment network combines homography matrix and Thin Plate Spline (TPS) transformations to accommodate tissue deformation during imaging, supported by a Non-Maximum Suppression Feature Displacement Layer that simultaneously considers both long-range and short-range dependencies, yielding more accurate results with reduced memory consumption. To achieve smooth and seamless image fusion, we employ a GAN framework where the generator is designed to produce fusion probability maps that eliminate noticeable blending seams and fusion artifacts. This is an innovative attempt to apply deep learning for precise image stitching in confocal superficial eyelid image, demonstrating 40% higher success rate than traditional methods. Quantitative evaluations show 13.37% and 3.25% improvements in mPSNR and mSSIM over the state-of-the-art model, with 11.29% and 3.76% reductions in NIQE and PIQE metrics.</div></div>","PeriodicalId":55362,"journal":{"name":"Biomedical Signal Processing and Control","volume":"112 ","pages":"Article 108760"},"PeriodicalIF":4.9000,"publicationDate":"2025-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Unsupervised confocal superficial eyelid image stitching: Flexible, accurate and smooth\",\"authors\":\"Lei Huo ,&nbsp;Lei Qin ,&nbsp;Shengyu Wu ,&nbsp;Ming Li ,&nbsp;Wei Yan ,&nbsp;Long Chang ,&nbsp;Shengli Mi\",\"doi\":\"10.1016/j.bspc.2025.108760\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Confocal laser scanning microscope enables non-invasive ocular Demodex screening but faces field-of-view (FOV) limitations. Although image stitching can theoretically expand FOV, traditional methods only achieve approximately 60% success rate due to low illumination, weak textures and repetitive patterns. To address these challenges, we propose an unsupervised deep learning-based image stitching framework with dual-stage alignment and generative adversarial network (GAN)-based fusion. Our dual-stage alignment network combines homography matrix and Thin Plate Spline (TPS) transformations to accommodate tissue deformation during imaging, supported by a Non-Maximum Suppression Feature Displacement Layer that simultaneously considers both long-range and short-range dependencies, yielding more accurate results with reduced memory consumption. To achieve smooth and seamless image fusion, we employ a GAN framework where the generator is designed to produce fusion probability maps that eliminate noticeable blending seams and fusion artifacts. This is an innovative attempt to apply deep learning for precise image stitching in confocal superficial eyelid image, demonstrating 40% higher success rate than traditional methods. Quantitative evaluations show 13.37% and 3.25% improvements in mPSNR and mSSIM over the state-of-the-art model, with 11.29% and 3.76% reductions in NIQE and PIQE metrics.</div></div>\",\"PeriodicalId\":55362,\"journal\":{\"name\":\"Biomedical Signal Processing and Control\",\"volume\":\"112 \",\"pages\":\"Article 108760\"},\"PeriodicalIF\":4.9000,\"publicationDate\":\"2025-10-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Biomedical Signal Processing and Control\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1746809425012716\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical Signal Processing and Control","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1746809425012716","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

摘要

共聚焦激光扫描显微镜可以实现非侵入性眼蠕形螨筛查,但存在视场(FOV)限制。虽然图像拼接理论上可以扩大视场,但传统方法由于光照不足、纹理弱、图案重复等问题,成功率仅为60%左右。为了解决这些挑战,我们提出了一种基于无监督深度学习的图像拼接框架,该框架具有双阶段对齐和基于生成对抗网络(GAN)的融合。我们的双级对准网络结合了单应性矩阵和薄板样条(TPS)变换,以适应成像过程中的组织变形,并由非最大抑制特征位移层支持,同时考虑远程和短程依赖关系,在减少内存消耗的情况下产生更准确的结果。为了实现平滑无缝的图像融合,我们采用了GAN框架,其中生成器被设计为生成融合概率图,消除明显的混合接缝和融合伪影。这是将深度学习应用于共聚焦浅眼睑图像的精确图像拼接的创新尝试,其成功率比传统方法提高了40%。定量评估显示,与最先进的模型相比,mPSNR和mSSIM分别提高了13.37%和3.25%,NIQE和PIQE分别降低了11.29%和3.76%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Unsupervised confocal superficial eyelid image stitching: Flexible, accurate and smooth
Confocal laser scanning microscope enables non-invasive ocular Demodex screening but faces field-of-view (FOV) limitations. Although image stitching can theoretically expand FOV, traditional methods only achieve approximately 60% success rate due to low illumination, weak textures and repetitive patterns. To address these challenges, we propose an unsupervised deep learning-based image stitching framework with dual-stage alignment and generative adversarial network (GAN)-based fusion. Our dual-stage alignment network combines homography matrix and Thin Plate Spline (TPS) transformations to accommodate tissue deformation during imaging, supported by a Non-Maximum Suppression Feature Displacement Layer that simultaneously considers both long-range and short-range dependencies, yielding more accurate results with reduced memory consumption. To achieve smooth and seamless image fusion, we employ a GAN framework where the generator is designed to produce fusion probability maps that eliminate noticeable blending seams and fusion artifacts. This is an innovative attempt to apply deep learning for precise image stitching in confocal superficial eyelid image, demonstrating 40% higher success rate than traditional methods. Quantitative evaluations show 13.37% and 3.25% improvements in mPSNR and mSSIM over the state-of-the-art model, with 11.29% and 3.76% reductions in NIQE and PIQE metrics.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Biomedical Signal Processing and Control
Biomedical Signal Processing and Control 工程技术-工程:生物医学
CiteScore
9.80
自引率
13.70%
发文量
822
审稿时长
4 months
期刊介绍: Biomedical Signal Processing and Control aims to provide a cross-disciplinary international forum for the interchange of information on research in the measurement and analysis of signals and images in clinical medicine and the biological sciences. Emphasis is placed on contributions dealing with the practical, applications-led research on the use of methods and devices in clinical diagnosis, patient monitoring and management. Biomedical Signal Processing and Control reflects the main areas in which these methods are being used and developed at the interface of both engineering and clinical science. The scope of the journal is defined to include relevant review papers, technical notes, short communications and letters. Tutorial papers and special issues will also be published.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信