Qingran Miao;Haixia Wang;Yilong Zhang;Rui Yan;Yipeng Liu
{"title":"Sweat Gland Enhancement Method for Fingertip OCT Images Based on Generative Adversarial Network","authors":"Qingran Miao;Haixia Wang;Yilong Zhang;Rui Yan;Yipeng Liu","doi":"10.1109/TBIOM.2024.3459812","DOIUrl":null,"url":null,"abstract":"Sweat pores are gaining recognition as a secure, reliable, and identifiable third-level fingerprint feature. Challenges arise in collecting sweat pores when fingers are contaminated, dry, or damaged, leading to unclear or vanished surface sweat pores. Optical Coherence Tomography (OCT) has been applied in the collection of fingertip biometric features. The sweat pores mapped from the subcutaneous sweat glands collected by OCT possess higher security and stability. However, speckle noise in OCT images can blur sweat glands making segmentation and extraction difficult. Traditional denoising methods cause unclear sweat gland contours and structural loss due to smearing and excessive smoothing. Deep learning-based methods have not achieved good results due to the lack of clean images as ground-truth. This paper proposes a sweat gland enhancement method for fingertip OCT images based on Generative Adversarial Network (GAN). It can effectively remove speckle noise while eliminating irrelevant structures and repairing the lost structure of sweat glands, ultimately improving the accuracy of sweat gland segmentation and extraction. To the best knowledge, it is the first time that sweat gland enhancement is investigated and proposed. In this method, a paired dataset generation strategy is proposed, which can extend few manually enhanced ground-truth into a high-quality paired dataset. An improved Pix2Pix for sweat gland enhancement is proposed, with the addition of a perceptual loss to mitigate structural distortions during the image translation process. It’s worth noting that after obtaining the paired dataset, any advanced supervised image-to-image translation network can be adapted into our framework for enhancement. Experiments are carried out to verify the effectiveness of the proposed method.","PeriodicalId":73307,"journal":{"name":"IEEE transactions on biometrics, behavior, and identity science","volume":"6 4","pages":"550-560"},"PeriodicalIF":0.0000,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on biometrics, behavior, and identity science","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10680136/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Sweat pores are gaining recognition as a secure, reliable, and identifiable third-level fingerprint feature. Challenges arise in collecting sweat pores when fingers are contaminated, dry, or damaged, leading to unclear or vanished surface sweat pores. Optical Coherence Tomography (OCT) has been applied in the collection of fingertip biometric features. The sweat pores mapped from the subcutaneous sweat glands collected by OCT possess higher security and stability. However, speckle noise in OCT images can blur sweat glands making segmentation and extraction difficult. Traditional denoising methods cause unclear sweat gland contours and structural loss due to smearing and excessive smoothing. Deep learning-based methods have not achieved good results due to the lack of clean images as ground-truth. This paper proposes a sweat gland enhancement method for fingertip OCT images based on Generative Adversarial Network (GAN). It can effectively remove speckle noise while eliminating irrelevant structures and repairing the lost structure of sweat glands, ultimately improving the accuracy of sweat gland segmentation and extraction. To the best knowledge, it is the first time that sweat gland enhancement is investigated and proposed. In this method, a paired dataset generation strategy is proposed, which can extend few manually enhanced ground-truth into a high-quality paired dataset. An improved Pix2Pix for sweat gland enhancement is proposed, with the addition of a perceptual loss to mitigate structural distortions during the image translation process. It’s worth noting that after obtaining the paired dataset, any advanced supervised image-to-image translation network can be adapted into our framework for enhancement. Experiments are carried out to verify the effectiveness of the proposed method.
汗孔作为一种安全、可靠、可识别的第三级指纹特征,正逐渐得到认可。当手指受到污染、干燥或损坏,导致表面汗毛孔不清晰或消失时,收集汗毛孔就会面临挑战。光学相干断层扫描(OCT)已被用于收集指尖生物特征。通过 OCT 采集的皮下汗腺汗孔图具有更高的安全性和稳定性。然而,OCT 图像中的斑点噪声会使汗腺模糊不清,导致难以分割和提取。传统的去噪方法会导致汗腺轮廓不清晰,并因涂抹和过度平滑而造成结构损失。基于深度学习的方法由于缺乏干净的图像作为基础真相,因此没有取得很好的效果。本文提出了一种基于生成对抗网络(GAN)的指尖 OCT 图像汗腺增强方法。它能有效去除斑点噪声,同时剔除无关结构,修复丢失的汗腺结构,最终提高汗腺分割和提取的准确性。据了解,这是首次研究并提出汗腺增强方法。该方法提出了一种配对数据集生成策略,可将少量人工增强的地面实况扩展为高质量的配对数据集。该方法提出了一种用于汗腺增强的改进型 Pix2Pix,并增加了感知损失,以减轻图像转换过程中的结构失真。值得注意的是,在获得配对数据集后,任何先进的有监督图像到图像翻译网络都可以适应我们的增强框架。实验验证了所提方法的有效性。