基于生成式对抗网络的指尖 OCT 图像汗腺增强方法

Qingran Miao;Haixia Wang;Yilong Zhang;Rui Yan;Yipeng Liu
{"title":"基于生成式对抗网络的指尖 OCT 图像汗腺增强方法","authors":"Qingran Miao;Haixia Wang;Yilong Zhang;Rui Yan;Yipeng Liu","doi":"10.1109/TBIOM.2024.3459812","DOIUrl":null,"url":null,"abstract":"Sweat pores are gaining recognition as a secure, reliable, and identifiable third-level fingerprint feature. Challenges arise in collecting sweat pores when fingers are contaminated, dry, or damaged, leading to unclear or vanished surface sweat pores. Optical Coherence Tomography (OCT) has been applied in the collection of fingertip biometric features. The sweat pores mapped from the subcutaneous sweat glands collected by OCT possess higher security and stability. However, speckle noise in OCT images can blur sweat glands making segmentation and extraction difficult. Traditional denoising methods cause unclear sweat gland contours and structural loss due to smearing and excessive smoothing. Deep learning-based methods have not achieved good results due to the lack of clean images as ground-truth. This paper proposes a sweat gland enhancement method for fingertip OCT images based on Generative Adversarial Network (GAN). It can effectively remove speckle noise while eliminating irrelevant structures and repairing the lost structure of sweat glands, ultimately improving the accuracy of sweat gland segmentation and extraction. To the best knowledge, it is the first time that sweat gland enhancement is investigated and proposed. In this method, a paired dataset generation strategy is proposed, which can extend few manually enhanced ground-truth into a high-quality paired dataset. An improved Pix2Pix for sweat gland enhancement is proposed, with the addition of a perceptual loss to mitigate structural distortions during the image translation process. It’s worth noting that after obtaining the paired dataset, any advanced supervised image-to-image translation network can be adapted into our framework for enhancement. Experiments are carried out to verify the effectiveness of the proposed method.","PeriodicalId":73307,"journal":{"name":"IEEE transactions on biometrics, behavior, and identity science","volume":"6 4","pages":"550-560"},"PeriodicalIF":0.0000,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Sweat Gland Enhancement Method for Fingertip OCT Images Based on Generative Adversarial Network\",\"authors\":\"Qingran Miao;Haixia Wang;Yilong Zhang;Rui Yan;Yipeng Liu\",\"doi\":\"10.1109/TBIOM.2024.3459812\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Sweat pores are gaining recognition as a secure, reliable, and identifiable third-level fingerprint feature. Challenges arise in collecting sweat pores when fingers are contaminated, dry, or damaged, leading to unclear or vanished surface sweat pores. Optical Coherence Tomography (OCT) has been applied in the collection of fingertip biometric features. The sweat pores mapped from the subcutaneous sweat glands collected by OCT possess higher security and stability. However, speckle noise in OCT images can blur sweat glands making segmentation and extraction difficult. Traditional denoising methods cause unclear sweat gland contours and structural loss due to smearing and excessive smoothing. Deep learning-based methods have not achieved good results due to the lack of clean images as ground-truth. This paper proposes a sweat gland enhancement method for fingertip OCT images based on Generative Adversarial Network (GAN). It can effectively remove speckle noise while eliminating irrelevant structures and repairing the lost structure of sweat glands, ultimately improving the accuracy of sweat gland segmentation and extraction. To the best knowledge, it is the first time that sweat gland enhancement is investigated and proposed. In this method, a paired dataset generation strategy is proposed, which can extend few manually enhanced ground-truth into a high-quality paired dataset. An improved Pix2Pix for sweat gland enhancement is proposed, with the addition of a perceptual loss to mitigate structural distortions during the image translation process. It’s worth noting that after obtaining the paired dataset, any advanced supervised image-to-image translation network can be adapted into our framework for enhancement. Experiments are carried out to verify the effectiveness of the proposed method.\",\"PeriodicalId\":73307,\"journal\":{\"name\":\"IEEE transactions on biometrics, behavior, and identity science\",\"volume\":\"6 4\",\"pages\":\"550-560\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE transactions on biometrics, behavior, and identity science\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10680136/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on biometrics, behavior, and identity science","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10680136/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

汗孔作为一种安全、可靠、可识别的第三级指纹特征,正逐渐得到认可。当手指受到污染、干燥或损坏,导致表面汗毛孔不清晰或消失时,收集汗毛孔就会面临挑战。光学相干断层扫描(OCT)已被用于收集指尖生物特征。通过 OCT 采集的皮下汗腺汗孔图具有更高的安全性和稳定性。然而,OCT 图像中的斑点噪声会使汗腺模糊不清,导致难以分割和提取。传统的去噪方法会导致汗腺轮廓不清晰,并因涂抹和过度平滑而造成结构损失。基于深度学习的方法由于缺乏干净的图像作为基础真相,因此没有取得很好的效果。本文提出了一种基于生成对抗网络(GAN)的指尖 OCT 图像汗腺增强方法。它能有效去除斑点噪声,同时剔除无关结构,修复丢失的汗腺结构,最终提高汗腺分割和提取的准确性。据了解,这是首次研究并提出汗腺增强方法。该方法提出了一种配对数据集生成策略,可将少量人工增强的地面实况扩展为高质量的配对数据集。该方法提出了一种用于汗腺增强的改进型 Pix2Pix,并增加了感知损失,以减轻图像转换过程中的结构失真。值得注意的是,在获得配对数据集后,任何先进的有监督图像到图像翻译网络都可以适应我们的增强框架。实验验证了所提方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Sweat Gland Enhancement Method for Fingertip OCT Images Based on Generative Adversarial Network
Sweat pores are gaining recognition as a secure, reliable, and identifiable third-level fingerprint feature. Challenges arise in collecting sweat pores when fingers are contaminated, dry, or damaged, leading to unclear or vanished surface sweat pores. Optical Coherence Tomography (OCT) has been applied in the collection of fingertip biometric features. The sweat pores mapped from the subcutaneous sweat glands collected by OCT possess higher security and stability. However, speckle noise in OCT images can blur sweat glands making segmentation and extraction difficult. Traditional denoising methods cause unclear sweat gland contours and structural loss due to smearing and excessive smoothing. Deep learning-based methods have not achieved good results due to the lack of clean images as ground-truth. This paper proposes a sweat gland enhancement method for fingertip OCT images based on Generative Adversarial Network (GAN). It can effectively remove speckle noise while eliminating irrelevant structures and repairing the lost structure of sweat glands, ultimately improving the accuracy of sweat gland segmentation and extraction. To the best knowledge, it is the first time that sweat gland enhancement is investigated and proposed. In this method, a paired dataset generation strategy is proposed, which can extend few manually enhanced ground-truth into a high-quality paired dataset. An improved Pix2Pix for sweat gland enhancement is proposed, with the addition of a perceptual loss to mitigate structural distortions during the image translation process. It’s worth noting that after obtaining the paired dataset, any advanced supervised image-to-image translation network can be adapted into our framework for enhancement. Experiments are carried out to verify the effectiveness of the proposed method.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
10.90
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信