Aliva Bakshi, Jake Stetson, Lihua Wang, Jishu Shi, Doina Caragea, Laura C Miller
{"title":"Toward a rapid, sensitive, user-friendly, field-deployable artificial intelligence tool for enhancing African swine fever diagnosis and reporting.","authors":"Aliva Bakshi, Jake Stetson, Lihua Wang, Jishu Shi, Doina Caragea, Laura C Miller","doi":"10.2460/ajvr.24.10.0305","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>African swine fever (ASF) is a lethal and highly contagious transboundary animal disease with the potential for rapid international spread. Lateral flow assays (LFAs) are sometimes hard to read by the inexperienced user, mainly due to the LFA sensitivity and reading ambiguities. Our objective was to develop and implement an AI-powered tool to enhance the accuracy of LFA reading, thereby improving rapid and early detection for ASF diagnosis and reporting.</p><p><strong>Methods: </strong>Here, we focus on the development of a deep learning-assisted, smartphone-based AI diagnostic tool to provide accurate decisions with higher sensitivity. The tool employs state-of-the-art You Only Look Once (YOLO) models for image classification. The YOLO models were trained and evaluated using a dataset consisting of images where the lateral flow assays are manually labeled as positives or negatives. A prototype JavaScript website application for ASF reporting and visualization was created in Azure. The application maintains the distribution of the positive predictions on a map as the positive cases are submitted by users.</p><p><strong>Results: </strong>The performance of the models is evaluated using standard evaluation metrics for classification tasks, specifically accuracy, precision, recall, sensitivity, specificity, and F1 measure. We acquired 86.3 ± 7.9% average accuracy, 96.3 ± 2.04% average precision, 79 ± 13.20% average recall, and an average F1 score of 0.87 ± 0.088 across 3 different train/development/test splits of the datasets. Submitting a positive result of the deep learning model updates a map with a location marker for positive results.</p><p><strong>Conclusions: </strong>Combining clinical data learning and 2-step algorithms enables a point-of-need assay with higher accuracy.</p><p><strong>Clinical relevance: </strong>A rapid, sensitive, user-friendly, and deployable deep learning tool was developed for classifying LFA test images to enhance diagnosis and reporting, particularly in settings with limited laboratory resources.</p>","PeriodicalId":7754,"journal":{"name":"American journal of veterinary research","volume":" ","pages":"S27-S37"},"PeriodicalIF":1.3000,"publicationDate":"2025-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11957874/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"American journal of veterinary research","FirstCategoryId":"97","ListUrlMain":"https://doi.org/10.2460/ajvr.24.10.0305","RegionNum":3,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/3/1 0:00:00","PubModel":"Print","JCR":"Q2","JCRName":"VETERINARY SCIENCES","Score":null,"Total":0}
Toward a rapid, sensitive, user-friendly, field-deployable artificial intelligence tool for enhancing African swine fever diagnosis and reporting.
Objective: African swine fever (ASF) is a lethal and highly contagious transboundary animal disease with the potential for rapid international spread. Lateral flow assays (LFAs) are sometimes hard to read by the inexperienced user, mainly due to the LFA sensitivity and reading ambiguities. Our objective was to develop and implement an AI-powered tool to enhance the accuracy of LFA reading, thereby improving rapid and early detection for ASF diagnosis and reporting.
Methods: Here, we focus on the development of a deep learning-assisted, smartphone-based AI diagnostic tool to provide accurate decisions with higher sensitivity. The tool employs state-of-the-art You Only Look Once (YOLO) models for image classification. The YOLO models were trained and evaluated using a dataset consisting of images where the lateral flow assays are manually labeled as positives or negatives. A prototype JavaScript website application for ASF reporting and visualization was created in Azure. The application maintains the distribution of the positive predictions on a map as the positive cases are submitted by users.
Results: The performance of the models is evaluated using standard evaluation metrics for classification tasks, specifically accuracy, precision, recall, sensitivity, specificity, and F1 measure. We acquired 86.3 ± 7.9% average accuracy, 96.3 ± 2.04% average precision, 79 ± 13.20% average recall, and an average F1 score of 0.87 ± 0.088 across 3 different train/development/test splits of the datasets. Submitting a positive result of the deep learning model updates a map with a location marker for positive results.
Conclusions: Combining clinical data learning and 2-step algorithms enables a point-of-need assay with higher accuracy.
Clinical relevance: A rapid, sensitive, user-friendly, and deployable deep learning tool was developed for classifying LFA test images to enhance diagnosis and reporting, particularly in settings with limited laboratory resources.
期刊介绍:
The American Journal of Veterinary Research supports the collaborative exchange of information between researchers and clinicians by publishing novel research findings that bridge the gulf between basic research and clinical practice or that help to translate laboratory research and preclinical studies to the development of clinical trials and clinical practice. The journal welcomes submission of high-quality original studies and review articles in a wide range of scientific fields, including anatomy, anesthesiology, animal welfare, behavior, epidemiology, genetics, heredity, infectious disease, molecular biology, oncology, pharmacology, pathogenic mechanisms, physiology, surgery, theriogenology, toxicology, and vaccinology. Species of interest include production animals, companion animals, equids, exotic animals, birds, reptiles, and wild and marine animals. Reports of laboratory animal studies and studies involving the use of animals as experimental models of human diseases are considered only when the study results are of demonstrable benefit to the species used in the research or to another species of veterinary interest. Other fields of interest or animals species are not necessarily excluded from consideration, but such reports must focus on novel research findings. Submitted papers must make an original and substantial contribution to the veterinary medicine knowledge base; preliminary studies are not appropriate.