Validation of Vetscan Imagyst®, a diagnostic test utilizing an artificial intelligence deep learning algorithm, for detecting strongyles and Parascaris spp. in equine fecal samples.
Ashley Steuer, Jason Fritzler, SaraBeth Boggan, Ian Daniel, Bobby Cowles, Cory Penn, Richard Goldstein, Dan Lin
{"title":"Validation of Vetscan Imagyst<sup>®</sup>, a diagnostic test utilizing an artificial intelligence deep learning algorithm, for detecting strongyles and Parascaris spp. in equine fecal samples.","authors":"Ashley Steuer, Jason Fritzler, SaraBeth Boggan, Ian Daniel, Bobby Cowles, Cory Penn, Richard Goldstein, Dan Lin","doi":"10.1186/s13071-024-06525-w","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Current methods for obtaining fecal egg counts in horses are often inaccurate and variable depending on the analyst's skill and experience. Automated digital scanning of fecal sample slides integrated with analysis by an artificial intelligence (AI) algorithm is a viable, emerging alternative that can mitigate operator variation compared to conventional methods in companion animal fecal parasite diagnostics. Vetscan Imagyst is a novel fecal parasite detection system that uploads the scanned image to the cloud where proprietary software analyzes captured images for diagnostic recognition by a deep learning, object detection AI algorithm. The study describes the use and validation of Vetscan Imagyst in equine parasitology.</p><p><strong>Methods: </strong>The primary objective of the study was to evaluate the performance of the Vetscan Imagyst system in terms of diagnostic sensitivity and specificity in testing equine fecal samples (n = 108) for ova from two parasites that commonly infect horses, strongyles and Parascaris spp., compared to reference assays performed by expert parasitologists using a Mini-FLOTAC technique. Two different fecal flotation solutions were used to prepare the sample slides, NaNO<sub>3</sub> and Sheather's sugar solution.</p><p><strong>Results: </strong>Diagnostic sensitivity of the Vetscan Imagyst algorithm for strongyles versus the manual reference test was 99.2% for samples prepared with NaNO<sub>3</sub> solution and 100.0% for samples prepared with Sheather's sugar solution. Sensitivity for Parascaris spp. was 88.9% and 99.9%, respectively, for samples prepared with NaNO<sub>3</sub> and Sheather's sugar solutions. Diagnostic specificity for strongyles was 91.4% and 99.9%, respectively, for samples prepared with NaNO<sub>3</sub> and Sheather's sugar solutions. Specificity for Parascaris spp. was 93.6% and 99.9%, respectively, for samples prepared with NaNO<sub>3</sub> and Sheather's sugar solutions. Lin's concordance correlation coefficients for VETSCAN IMAGYST eggs per gram counts versus those determined by the expert parasitologist were 0.924-0.978 for strongyles and 0.944-0.955 for Parascaris spp., depending on the flotation solution.</p><p><strong>Conclusions: </strong>Sensitivity and specificity results for detecting strongyles and Parascaris spp. in equine fecal samples showed that Vetscan Imagyst can consistently provide diagnostic accuracy equivalent to manual evaluations by skilled parasitologists. As an automated method driven by a deep learning AI algorithm, VETSCAN IMAGYST has the potential to avoid variations in analyst characteristics, thus providing more consistent results in a timely manner, in either clinical or laboratory settings.</p>","PeriodicalId":19793,"journal":{"name":"Parasites & Vectors","volume":"17 1","pages":"465"},"PeriodicalIF":3.0000,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11558902/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Parasites & Vectors","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s13071-024-06525-w","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PARASITOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Current methods for obtaining fecal egg counts in horses are often inaccurate and variable depending on the analyst's skill and experience. Automated digital scanning of fecal sample slides integrated with analysis by an artificial intelligence (AI) algorithm is a viable, emerging alternative that can mitigate operator variation compared to conventional methods in companion animal fecal parasite diagnostics. Vetscan Imagyst is a novel fecal parasite detection system that uploads the scanned image to the cloud where proprietary software analyzes captured images for diagnostic recognition by a deep learning, object detection AI algorithm. The study describes the use and validation of Vetscan Imagyst in equine parasitology.
Methods: The primary objective of the study was to evaluate the performance of the Vetscan Imagyst system in terms of diagnostic sensitivity and specificity in testing equine fecal samples (n = 108) for ova from two parasites that commonly infect horses, strongyles and Parascaris spp., compared to reference assays performed by expert parasitologists using a Mini-FLOTAC technique. Two different fecal flotation solutions were used to prepare the sample slides, NaNO3 and Sheather's sugar solution.
Results: Diagnostic sensitivity of the Vetscan Imagyst algorithm for strongyles versus the manual reference test was 99.2% for samples prepared with NaNO3 solution and 100.0% for samples prepared with Sheather's sugar solution. Sensitivity for Parascaris spp. was 88.9% and 99.9%, respectively, for samples prepared with NaNO3 and Sheather's sugar solutions. Diagnostic specificity for strongyles was 91.4% and 99.9%, respectively, for samples prepared with NaNO3 and Sheather's sugar solutions. Specificity for Parascaris spp. was 93.6% and 99.9%, respectively, for samples prepared with NaNO3 and Sheather's sugar solutions. Lin's concordance correlation coefficients for VETSCAN IMAGYST eggs per gram counts versus those determined by the expert parasitologist were 0.924-0.978 for strongyles and 0.944-0.955 for Parascaris spp., depending on the flotation solution.
Conclusions: Sensitivity and specificity results for detecting strongyles and Parascaris spp. in equine fecal samples showed that Vetscan Imagyst can consistently provide diagnostic accuracy equivalent to manual evaluations by skilled parasitologists. As an automated method driven by a deep learning AI algorithm, VETSCAN IMAGYST has the potential to avoid variations in analyst characteristics, thus providing more consistent results in a timely manner, in either clinical or laboratory settings.
期刊介绍:
Parasites & Vectors is an open access, peer-reviewed online journal dealing with the biology of parasites, parasitic diseases, intermediate hosts, vectors and vector-borne pathogens. Manuscripts published in this journal will be available to all worldwide, with no barriers to access, immediately following acceptance. However, authors retain the copyright of their material and may use it, or distribute it, as they wish.
Manuscripts on all aspects of the basic and applied biology of parasites, intermediate hosts, vectors and vector-borne pathogens will be considered. In addition to the traditional and well-established areas of science in these fields, we also aim to provide a vehicle for publication of the rapidly developing resources and technology in parasite, intermediate host and vector genomics and their impacts on biological research. We are able to publish large datasets and extensive results, frequently associated with genomic and post-genomic technologies, which are not readily accommodated in traditional journals. Manuscripts addressing broader issues, for example economics, social sciences and global climate change in relation to parasites, vectors and disease control, are also welcomed.