Deep learning for AI-based diagnosis of skin-related neglected tropical diseases: A pilot study.

IF 3.8 2区 医学 Q1 Medicine
PLoS Neglected Tropical Diseases Pub Date : 2023-08-14 eCollection Date: 2023-08-01 DOI:10.1371/journal.pntd.0011230
Rie R Yotsu, Zhengming Ding, Jihun Hamm, Ronald E Blanton
{"title":"Deep learning for AI-based diagnosis of skin-related neglected tropical diseases: A pilot study.","authors":"Rie R Yotsu, Zhengming Ding, Jihun Hamm, Ronald E Blanton","doi":"10.1371/journal.pntd.0011230","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Deep learning, which is a part of a broader concept of artificial intelligence (AI) and/or machine learning has achieved remarkable success in vision tasks. While there is growing interest in the use of this technology in diagnostic support for skin-related neglected tropical diseases (skin NTDs), there have been limited studies in this area and fewer focused on dark skin. In this study, we aimed to develop deep learning based AI models with clinical images we collected for five skin NTDs, namely, Buruli ulcer, leprosy, mycetoma, scabies, and yaws, to understand how diagnostic accuracy can or cannot be improved using different models and training patterns.</p><p><strong>Methodology: </strong>This study used photographs collected prospectively in Côte d'Ivoire and Ghana through our ongoing studies with use of digital health tools for clinical data documentation and for teledermatology. Our dataset included a total of 1,709 images from 506 patients. Two convolutional neural networks, ResNet-50 and VGG-16 models were adopted to examine the performance of different deep learning architectures and validate their feasibility in diagnosis of the targeted skin NTDs.</p><p><strong>Principal findings: </strong>The two models were able to correctly predict over 70% of the diagnoses, and there was a consistent performance improvement with more training samples. The ResNet-50 model performed better than the VGG-16 model. A model trained with PCR confirmed cases of Buruli ulcer yielded 1-3% increase in prediction accuracy across all diseases, except, for mycetoma, over a model which training sets included unconfirmed cases.</p><p><strong>Conclusions: </strong>Our approach was to have the deep learning model distinguish between multiple pathologies simultaneously-which is close to real-world practice. The more images used for training, the more accurate the diagnosis became. The percentages of correct diagnosis increased with PCR-positive cases of Buruli ulcer. This demonstrated that it may be better to input images from the more accurately diagnosed cases in the training models also for achieving better accuracy in the generated AI models. However, the increase was marginal which may be an indication that the accuracy of clinical diagnosis alone is reliable to an extent for Buruli ulcer. Diagnostic tests also have their flaws, and they are not always reliable. One hope for AI is that it will objectively resolve this gap between diagnostic tests and clinical diagnoses with the addition of another tool. While there are still challenges to be overcome, there is a potential for AI to address the unmet needs where access to medical care is limited, like for those affected by skin NTDs.</p>","PeriodicalId":20260,"journal":{"name":"PLoS Neglected Tropical Diseases","volume":"17 8","pages":"e0011230"},"PeriodicalIF":3.8000,"publicationDate":"2023-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10449179/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"PLoS Neglected Tropical Diseases","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1371/journal.pntd.0011230","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/8/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Deep learning, which is a part of a broader concept of artificial intelligence (AI) and/or machine learning has achieved remarkable success in vision tasks. While there is growing interest in the use of this technology in diagnostic support for skin-related neglected tropical diseases (skin NTDs), there have been limited studies in this area and fewer focused on dark skin. In this study, we aimed to develop deep learning based AI models with clinical images we collected for five skin NTDs, namely, Buruli ulcer, leprosy, mycetoma, scabies, and yaws, to understand how diagnostic accuracy can or cannot be improved using different models and training patterns.

Methodology: This study used photographs collected prospectively in Côte d'Ivoire and Ghana through our ongoing studies with use of digital health tools for clinical data documentation and for teledermatology. Our dataset included a total of 1,709 images from 506 patients. Two convolutional neural networks, ResNet-50 and VGG-16 models were adopted to examine the performance of different deep learning architectures and validate their feasibility in diagnosis of the targeted skin NTDs.

Principal findings: The two models were able to correctly predict over 70% of the diagnoses, and there was a consistent performance improvement with more training samples. The ResNet-50 model performed better than the VGG-16 model. A model trained with PCR confirmed cases of Buruli ulcer yielded 1-3% increase in prediction accuracy across all diseases, except, for mycetoma, over a model which training sets included unconfirmed cases.

Conclusions: Our approach was to have the deep learning model distinguish between multiple pathologies simultaneously-which is close to real-world practice. The more images used for training, the more accurate the diagnosis became. The percentages of correct diagnosis increased with PCR-positive cases of Buruli ulcer. This demonstrated that it may be better to input images from the more accurately diagnosed cases in the training models also for achieving better accuracy in the generated AI models. However, the increase was marginal which may be an indication that the accuracy of clinical diagnosis alone is reliable to an extent for Buruli ulcer. Diagnostic tests also have their flaws, and they are not always reliable. One hope for AI is that it will objectively resolve this gap between diagnostic tests and clinical diagnoses with the addition of another tool. While there are still challenges to be overcome, there is a potential for AI to address the unmet needs where access to medical care is limited, like for those affected by skin NTDs.

Abstract Image

Abstract Image

Abstract Image

基于人工智能的深度学习诊断与皮肤相关的被忽视的热带疾病:一项试点研究。
背景:深度学习是人工智能(AI)和/或机器学习更广泛概念的一部分,在视觉任务中取得了显著成功。尽管人们对将这项技术用于与皮肤相关的被忽视的热带疾病(皮肤NTD)的诊断支持越来越感兴趣,但该领域的研究有限,对深色皮肤的研究较少。在这项研究中,我们旨在利用我们为五种皮肤NTD(即布鲁里溃疡、麻风病、霉菌瘤、疥疮和雅司病)收集的临床图像,开发基于深度学习的人工智能模型,以了解如何使用不同的模型和训练模式来提高诊断准确性。方法:本研究使用了在科特迪瓦和加纳前瞻性收集的照片,通过我们正在进行的研究,使用数字健康工具进行临床数据记录和远程皮肤病学。我们的数据集包括506名患者的1709张图像。采用两个卷积神经网络,ResNet-50和VGG-16模型来检查不同深度学习架构的性能,并验证其在诊断目标皮肤NTD中的可行性。主要发现:这两个模型能够正确预测70%以上的诊断,并且随着训练样本的增加,性能持续提高。ResNet-50模型的性能优于VGG-16模型。用PCR确诊的布鲁里溃疡病例训练的模型在所有疾病中的预测准确率都提高了1-3%,除了霉菌瘤,与训练集包括未确诊病例的模型相比。结论:我们的方法是让深度学习模型同时区分多种病理,这与现实世界的实践非常接近。用于训练的图像越多,诊断就越准确。布鲁里溃疡的PCR阳性病例的正确诊断率增加。这表明,在训练模型中输入来自更准确诊断病例的图像可能更好,也可以在生成的AI模型中实现更好的准确性。然而,这种增加是微不足道的,这可能表明单独临床诊断的准确性在一定程度上对布鲁里溃疡是可靠的。诊断测试也有缺陷,而且并不总是可靠的。人工智能的一个希望是,它将通过添加另一种工具,客观地解决诊断测试和临床诊断之间的差距。尽管仍有挑战需要克服,但人工智能有潜力解决医疗服务有限的未满足需求,比如那些受皮肤NTD影响的人。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
PLoS Neglected Tropical Diseases
PLoS Neglected Tropical Diseases Medicine-Infectious Diseases
CiteScore
7.40
自引率
10.50%
发文量
723
审稿时长
2-3 weeks
期刊介绍: PLOS Neglected Tropical Diseases publishes research devoted to the pathology, epidemiology, prevention, treatment and control of the neglected tropical diseases (NTDs), as well as relevant public policy. The NTDs are defined as a group of poverty-promoting chronic infectious diseases, which primarily occur in rural areas and poor urban areas of low-income and middle-income countries. Their impact on child health and development, pregnancy, and worker productivity, as well as their stigmatizing features limit economic stability. All aspects of these diseases are considered, including: Pathogenesis Clinical features Pharmacology and treatment Diagnosis Epidemiology Vector biology Vaccinology and prevention Demographic, ecological and social determinants Public health and policy aspects (including cost-effectiveness analyses).
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信