深度学习模型在预测诊断细菌性阴道病的 nugent 评分中的表现。

IF 3.7 2区 生物学 Q2 MICROBIOLOGY
Naoki Watanabe, Tomohisa Watari, Kenji Akamatsu, Isao Miyatsuka, Yoshihito Otsuka
{"title":"深度学习模型在预测诊断细菌性阴道病的 nugent 评分中的表现。","authors":"Naoki Watanabe, Tomohisa Watari, Kenji Akamatsu, Isao Miyatsuka, Yoshihito Otsuka","doi":"10.1128/spectrum.02344-24","DOIUrl":null,"url":null,"abstract":"<p><p>The Nugent score is a commonly used diagnostic tool for bacterial vaginosis. However, its accuracy depends on the skills of laboratory technicians. This study aimed to evaluate the performance of deep learning models in predicting the Nugent score to improve diagnostic consistency and accuracy. In total, 1,510 vaginal smear images collected from a hospital in Japan between 2021 and 2023 were assessed. Each image was annotated by laboratory technicians into one of four categories based on the Nugent score-normal vaginal flora, no vaginal flora, altered vaginal flora, or bacterial vaginosis. Deep learning models were developed to predict these categories, and their performance was compared to that of technician annotations. The deep learning models demonstrated 84% accuracy at 400× magnification and 89% at 1,000× magnification. The 1,000× model was further optimized and tested on an independent set of 106 images. After optimization, the advanced model achieved 94% accuracy, outperforming the average 92% accuracy of the technicians. The agreement between the advanced model predictions and technicians was 92% for normal vaginal flora, 100% for no vaginal flora, 91% for altered vaginal flora, and 100% for bacterial vaginosis. Overall, our findings suggest that deep learning models have the potential to diagnose bacterial vaginosis with an accuracy comparable to that of laboratory technicians.IMPORTANCEBacterial vaginosis is a global health issue affecting women, causing symptoms such as abnormal vaginal discharge and discomfort. The Nugent score is a standard method for diagnosing bacterial vaginosis and is based on the manual interpretation of Gram-stained vaginal smears. However, this method relies on the skill and experience of trained professionals, leading to variability in results and poses significant challenges for settings with limited access to experienced technicians. The results of this study indicate that deep learning models can predict the Nugent score with high accuracy, offering the potential to standardize the diagnosis of bacterial vaginosis. By reducing observer variability, these models can facilitate reliable diagnoses, even in settings where experienced personnel are scarce. Although validation is needed on a larger scale, our results suggest that deep learning models may represent a new approach for diagnosing bacterial vaginosis.</p>","PeriodicalId":18670,"journal":{"name":"Microbiology spectrum","volume":" ","pages":"e0234424"},"PeriodicalIF":3.7000,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Performance of deep learning models in predicting the nugent score to diagnose bacterial vaginosis.\",\"authors\":\"Naoki Watanabe, Tomohisa Watari, Kenji Akamatsu, Isao Miyatsuka, Yoshihito Otsuka\",\"doi\":\"10.1128/spectrum.02344-24\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>The Nugent score is a commonly used diagnostic tool for bacterial vaginosis. However, its accuracy depends on the skills of laboratory technicians. This study aimed to evaluate the performance of deep learning models in predicting the Nugent score to improve diagnostic consistency and accuracy. In total, 1,510 vaginal smear images collected from a hospital in Japan between 2021 and 2023 were assessed. Each image was annotated by laboratory technicians into one of four categories based on the Nugent score-normal vaginal flora, no vaginal flora, altered vaginal flora, or bacterial vaginosis. Deep learning models were developed to predict these categories, and their performance was compared to that of technician annotations. The deep learning models demonstrated 84% accuracy at 400× magnification and 89% at 1,000× magnification. The 1,000× model was further optimized and tested on an independent set of 106 images. After optimization, the advanced model achieved 94% accuracy, outperforming the average 92% accuracy of the technicians. The agreement between the advanced model predictions and technicians was 92% for normal vaginal flora, 100% for no vaginal flora, 91% for altered vaginal flora, and 100% for bacterial vaginosis. Overall, our findings suggest that deep learning models have the potential to diagnose bacterial vaginosis with an accuracy comparable to that of laboratory technicians.IMPORTANCEBacterial vaginosis is a global health issue affecting women, causing symptoms such as abnormal vaginal discharge and discomfort. The Nugent score is a standard method for diagnosing bacterial vaginosis and is based on the manual interpretation of Gram-stained vaginal smears. However, this method relies on the skill and experience of trained professionals, leading to variability in results and poses significant challenges for settings with limited access to experienced technicians. The results of this study indicate that deep learning models can predict the Nugent score with high accuracy, offering the potential to standardize the diagnosis of bacterial vaginosis. By reducing observer variability, these models can facilitate reliable diagnoses, even in settings where experienced personnel are scarce. Although validation is needed on a larger scale, our results suggest that deep learning models may represent a new approach for diagnosing bacterial vaginosis.</p>\",\"PeriodicalId\":18670,\"journal\":{\"name\":\"Microbiology spectrum\",\"volume\":\" \",\"pages\":\"e0234424\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2024-11-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Microbiology spectrum\",\"FirstCategoryId\":\"99\",\"ListUrlMain\":\"https://doi.org/10.1128/spectrum.02344-24\",\"RegionNum\":2,\"RegionCategory\":\"生物学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MICROBIOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Microbiology spectrum","FirstCategoryId":"99","ListUrlMain":"https://doi.org/10.1128/spectrum.02344-24","RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MICROBIOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

纽金特评分是细菌性阴道病的常用诊断工具。然而,其准确性取决于实验室技术人员的技能。本研究旨在评估深度学习模型在预测 Nugent 评分方面的性能,以提高诊断的一致性和准确性。本研究共评估了 2021 年至 2023 年期间从日本一家医院收集的 1,510 张阴道涂片图像。实验室技术人员根据 Nugent 评分将每张图像分为四类--阴道正常菌群、无阴道菌群、阴道菌群改变或细菌性阴道病。我们开发了深度学习模型来预测这些类别,并将其性能与技术人员的注释进行了比较。深度学习模型在放大 400 倍时的准确率为 84%,放大 1000 倍时的准确率为 89%。1,000× 模型得到了进一步优化,并在一组独立的 106 幅图像上进行了测试。优化后,高级模型的准确率达到 94%,超过了技术人员平均 92% 的准确率。对于正常阴道菌群,高级模型的预测结果与技术人员的一致率为 92%;对于无阴道菌群,高级模型的预测结果与技术人员的一致率为 100%;对于阴道菌群改变,高级模型的预测结果与技术人员的一致率为 91%;对于细菌性阴道病,高级模型的预测结果与技术人员的一致率为 100%。总体而言,我们的研究结果表明,深度学习模型具有诊断细菌性阴道病的潜力,其准确率可与实验室技术人员媲美。 重要意义细菌性阴道病是影响妇女健康的全球性问题,会导致异常阴道分泌物和不适等症状。纽金特评分法是诊断细菌性阴道病的标准方法,它基于对革兰染色阴道涂片的人工判读。然而,这种方法依赖于训练有素的专业人员的技能和经验,导致结果的不一致性,给经验丰富的技术人员有限的环境带来了巨大挑战。本研究的结果表明,深度学习模型可以高精度预测 Nugent 评分,为细菌性阴道病的标准化诊断提供了可能。通过减少观察者的变异性,这些模型可以促进可靠的诊断,即使在缺乏有经验人员的情况下也是如此。虽然还需要更大规模的验证,但我们的研究结果表明,深度学习模型可能是诊断细菌性阴道病的一种新方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Performance of deep learning models in predicting the nugent score to diagnose bacterial vaginosis.

The Nugent score is a commonly used diagnostic tool for bacterial vaginosis. However, its accuracy depends on the skills of laboratory technicians. This study aimed to evaluate the performance of deep learning models in predicting the Nugent score to improve diagnostic consistency and accuracy. In total, 1,510 vaginal smear images collected from a hospital in Japan between 2021 and 2023 were assessed. Each image was annotated by laboratory technicians into one of four categories based on the Nugent score-normal vaginal flora, no vaginal flora, altered vaginal flora, or bacterial vaginosis. Deep learning models were developed to predict these categories, and their performance was compared to that of technician annotations. The deep learning models demonstrated 84% accuracy at 400× magnification and 89% at 1,000× magnification. The 1,000× model was further optimized and tested on an independent set of 106 images. After optimization, the advanced model achieved 94% accuracy, outperforming the average 92% accuracy of the technicians. The agreement between the advanced model predictions and technicians was 92% for normal vaginal flora, 100% for no vaginal flora, 91% for altered vaginal flora, and 100% for bacterial vaginosis. Overall, our findings suggest that deep learning models have the potential to diagnose bacterial vaginosis with an accuracy comparable to that of laboratory technicians.IMPORTANCEBacterial vaginosis is a global health issue affecting women, causing symptoms such as abnormal vaginal discharge and discomfort. The Nugent score is a standard method for diagnosing bacterial vaginosis and is based on the manual interpretation of Gram-stained vaginal smears. However, this method relies on the skill and experience of trained professionals, leading to variability in results and poses significant challenges for settings with limited access to experienced technicians. The results of this study indicate that deep learning models can predict the Nugent score with high accuracy, offering the potential to standardize the diagnosis of bacterial vaginosis. By reducing observer variability, these models can facilitate reliable diagnoses, even in settings where experienced personnel are scarce. Although validation is needed on a larger scale, our results suggest that deep learning models may represent a new approach for diagnosing bacterial vaginosis.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Microbiology spectrum
Microbiology spectrum Biochemistry, Genetics and Molecular Biology-Genetics
CiteScore
3.20
自引率
5.40%
发文量
1800
期刊介绍: Microbiology Spectrum publishes commissioned review articles on topics in microbiology representing ten content areas: Archaea; Food Microbiology; Bacterial Genetics, Cell Biology, and Physiology; Clinical Microbiology; Environmental Microbiology and Ecology; Eukaryotic Microbes; Genomics, Computational, and Synthetic Microbiology; Immunology; Pathogenesis; and Virology. Reviews are interrelated, with each review linking to other related content. A large board of Microbiology Spectrum editors aids in the development of topics for potential reviews and in the identification of an editor, or editors, who shepherd each collection.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信