基于端到端深度学习的显微白带图像中的细胞检测

IF 2.4 4区 地球科学 Q3 METEOROLOGY & ATMOSPHERIC SCIENCES
Ruqian Hao, Xiangzhou Wang, Xiaohui Du, Jing Zhang, Juanxiu Liu, Lin Liu
{"title":"基于端到端深度学习的显微白带图像中的细胞检测","authors":"Ruqian Hao, Xiangzhou Wang, Xiaohui Du, Jing Zhang, Juanxiu Liu, Lin Liu","doi":"10.1017/S1431927622000265","DOIUrl":null,"url":null,"abstract":"<p><p>Vaginitis is a prevalent gynecologic disease that threatens millions of women’s health. Although microscopic examination of vaginal discharge is an effective method to identify vaginal infections, manual analysis of microscopic leucorrhea images is extremely time-consuming and labor-intensive. To automate the detection and identification of visible components in microscopic leucorrhea images for early-stage diagnosis of vaginitis, we propose a novel end-to-end deep learning-based cells detection framework using attention-based detection with transformers (DETR) architecture. The transfer learning was applied to speed up the network convergence while maintaining the lowest annotation cost. To address the issue of detection performance degradation caused by class imbalance, the weighted sampler with on-the-fly data augmentation module was integrated into the detection pipeline. Additionally, the multi-head attention mechanism and the bipartite matching loss system of the DETR model perform well in identifying partially overlapping cells in real-time. With our proposed method, the pipeline achieved a mean average precision (mAP) of 86.00% and the average precision (AP) of epithelium, leukocyte, pyocyte, mildew, and erythrocyte was 96.76, 83.50, 74.20, 89.66, and 88.80%, respectively. The average test time for a microscopic leucorrhea image is approximately 72.3 ms. Currently, this cell detection method represents state-of-the-art performance.</p>","PeriodicalId":17476,"journal":{"name":"Journal of the Meteorological Society of Japan","volume":"39 1","pages":"1-12"},"PeriodicalIF":2.4000,"publicationDate":"2022-03-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"End-to-End Deep Learning-Based Cells Detection in Microscopic Leucorrhea Images.\",\"authors\":\"Ruqian Hao, Xiangzhou Wang, Xiaohui Du, Jing Zhang, Juanxiu Liu, Lin Liu\",\"doi\":\"10.1017/S1431927622000265\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Vaginitis is a prevalent gynecologic disease that threatens millions of women’s health. Although microscopic examination of vaginal discharge is an effective method to identify vaginal infections, manual analysis of microscopic leucorrhea images is extremely time-consuming and labor-intensive. To automate the detection and identification of visible components in microscopic leucorrhea images for early-stage diagnosis of vaginitis, we propose a novel end-to-end deep learning-based cells detection framework using attention-based detection with transformers (DETR) architecture. The transfer learning was applied to speed up the network convergence while maintaining the lowest annotation cost. To address the issue of detection performance degradation caused by class imbalance, the weighted sampler with on-the-fly data augmentation module was integrated into the detection pipeline. Additionally, the multi-head attention mechanism and the bipartite matching loss system of the DETR model perform well in identifying partially overlapping cells in real-time. With our proposed method, the pipeline achieved a mean average precision (mAP) of 86.00% and the average precision (AP) of epithelium, leukocyte, pyocyte, mildew, and erythrocyte was 96.76, 83.50, 74.20, 89.66, and 88.80%, respectively. The average test time for a microscopic leucorrhea image is approximately 72.3 ms. Currently, this cell detection method represents state-of-the-art performance.</p>\",\"PeriodicalId\":17476,\"journal\":{\"name\":\"Journal of the Meteorological Society of Japan\",\"volume\":\"39 1\",\"pages\":\"1-12\"},\"PeriodicalIF\":2.4000,\"publicationDate\":\"2022-03-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of the Meteorological Society of Japan\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1017/S1431927622000265\",\"RegionNum\":4,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"METEOROLOGY & ATMOSPHERIC SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the Meteorological Society of Japan","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1017/S1431927622000265","RegionNum":4,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"METEOROLOGY & ATMOSPHERIC SCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

阴道炎是一种普遍存在的妇科疾病,威胁着数百万妇女的健康。虽然显微镜检查阴道分泌物是识别阴道炎的有效方法,但人工分析白带显微图像非常耗时耗力。为了自动检测和识别显微镜下白带图像中的可见成分,以便对阴道炎进行早期诊断,我们提出了一种新颖的端到端基于深度学习的细胞检测框架,该框架采用基于注意力的变压器检测(DETR)架构。在保持最低标注成本的同时,我们还应用了迁移学习来加快网络收敛速度。为解决类不平衡导致的检测性能下降问题,在检测流水线中集成了带即时数据增强模块的加权采样器。此外,DETR 模型的多头关注机制和双匹配损失系统在实时识别部分重叠单元方面表现出色。通过我们提出的方法,管道的平均精度(mAP)达到了 86.00%,上皮细胞、白细胞、脓细胞、霉菌和红细胞的平均精度(AP)分别为 96.76%、83.50%、74.20%、89.66% 和 88.80%。显微白带图像的平均检测时间约为 72.3 毫秒。目前,这种细胞检测方法代表了最先进的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
End-to-End Deep Learning-Based Cells Detection in Microscopic Leucorrhea Images.

Vaginitis is a prevalent gynecologic disease that threatens millions of women’s health. Although microscopic examination of vaginal discharge is an effective method to identify vaginal infections, manual analysis of microscopic leucorrhea images is extremely time-consuming and labor-intensive. To automate the detection and identification of visible components in microscopic leucorrhea images for early-stage diagnosis of vaginitis, we propose a novel end-to-end deep learning-based cells detection framework using attention-based detection with transformers (DETR) architecture. The transfer learning was applied to speed up the network convergence while maintaining the lowest annotation cost. To address the issue of detection performance degradation caused by class imbalance, the weighted sampler with on-the-fly data augmentation module was integrated into the detection pipeline. Additionally, the multi-head attention mechanism and the bipartite matching loss system of the DETR model perform well in identifying partially overlapping cells in real-time. With our proposed method, the pipeline achieved a mean average precision (mAP) of 86.00% and the average precision (AP) of epithelium, leukocyte, pyocyte, mildew, and erythrocyte was 96.76, 83.50, 74.20, 89.66, and 88.80%, respectively. The average test time for a microscopic leucorrhea image is approximately 72.3 ms. Currently, this cell detection method represents state-of-the-art performance.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of the Meteorological Society of Japan
Journal of the Meteorological Society of Japan 地学-气象与大气科学
CiteScore
6.70
自引率
16.10%
发文量
56
审稿时长
3 months
期刊介绍: JMSJ publishes Articles and Notes and Correspondence that report novel scientific discoveries or technical developments that advance understanding in meteorology and related sciences. The journal’s broad scope includes meteorological observations, modeling, data assimilation, analyses, global and regional climate research, satellite remote sensing, chemistry and transport, and dynamic meteorology including geophysical fluid dynamics. In particular, JMSJ welcomes papers related to Asian monsoons, climate and mesoscale models, and numerical weather forecasts. Insightful and well-structured original Review Articles that describe the advances and challenges in meteorology and related sciences are also welcome.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信