Improving Lyme disease testing with data driven test design in pediatrics

Q2 Medicine
Mahmoud Elkhadrawi , Oscar Lopez-Nunez , Murat Akcakaya , Sarah E. Wheeler
{"title":"Improving Lyme disease testing with data driven test design in pediatrics","authors":"Mahmoud Elkhadrawi ,&nbsp;Oscar Lopez-Nunez ,&nbsp;Murat Akcakaya ,&nbsp;Sarah E. Wheeler","doi":"10.1016/j.jpi.2023.100300","DOIUrl":null,"url":null,"abstract":"<div><p>Diagnostic advances have not kept pace with the expansion of Lyme disease caused by <em>Borrelia burgdorferi</em> and transmitted by ticks. Lyme disease clinical manifestations can overlap with many other diagnoses making Lyme disease a critical part of many differential diagnoses in endemic areas. Current diagnostic blood tests rely on a 2-tiered algorithm for which the second step is either a time-consuming western blot or a whole cell lysate immunoassay. Neither of these second step tests allow for rapid results of this critical rule out test. We hypothesized that using western blot confirmation information, we could create computational models to propose recombinant second-tier tests that would allow for more rapid, automated, and specific testing algorithms. We propose here a framework for assessing retrospective data to determine putative recombinant assay components. A retrospective pediatric cohort of 2755 samples submitted for Lyme disease screening was assessed using support vector machine learning algorithms to optimize tier 1 diagnostic thresholds for the Vidas IgG II assay and determine optimal tier 2 components for both a positive and negative confirmation test. In cases where the tier 1 screen was negative, but clinical suspicion was high, we found that 1 protein (L58) could be used to reduce false-negative results. For second-tier testing of screen positive cases, we found that 6 proteins could be used to reduce false-positive results (L18, L39M, L39, L41, L45, and L58) with a final machine learning classifier or 2 proteins using a final rules-based approach (L41, L18). This led to an overall accuracy of 92.36% for the proposed algorithm without a final machine learning classifier and 92.12% with integration of the machine learning classifier in the final algorithm when compared to the IgG western blot as the gold-standard. Use of this framework across multiple assays and institutions will allow for a data-driven approach to assay development to provide laboratories and patients with the improvements in turnaround time needed for this testing.</p></div>","PeriodicalId":37769,"journal":{"name":"Journal of Pathology Informatics","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/f9/b6/main.PMC9985057.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Pathology Informatics","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2153353923001141","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0

Abstract

Diagnostic advances have not kept pace with the expansion of Lyme disease caused by Borrelia burgdorferi and transmitted by ticks. Lyme disease clinical manifestations can overlap with many other diagnoses making Lyme disease a critical part of many differential diagnoses in endemic areas. Current diagnostic blood tests rely on a 2-tiered algorithm for which the second step is either a time-consuming western blot or a whole cell lysate immunoassay. Neither of these second step tests allow for rapid results of this critical rule out test. We hypothesized that using western blot confirmation information, we could create computational models to propose recombinant second-tier tests that would allow for more rapid, automated, and specific testing algorithms. We propose here a framework for assessing retrospective data to determine putative recombinant assay components. A retrospective pediatric cohort of 2755 samples submitted for Lyme disease screening was assessed using support vector machine learning algorithms to optimize tier 1 diagnostic thresholds for the Vidas IgG II assay and determine optimal tier 2 components for both a positive and negative confirmation test. In cases where the tier 1 screen was negative, but clinical suspicion was high, we found that 1 protein (L58) could be used to reduce false-negative results. For second-tier testing of screen positive cases, we found that 6 proteins could be used to reduce false-positive results (L18, L39M, L39, L41, L45, and L58) with a final machine learning classifier or 2 proteins using a final rules-based approach (L41, L18). This led to an overall accuracy of 92.36% for the proposed algorithm without a final machine learning classifier and 92.12% with integration of the machine learning classifier in the final algorithm when compared to the IgG western blot as the gold-standard. Use of this framework across multiple assays and institutions will allow for a data-driven approach to assay development to provide laboratories and patients with the improvements in turnaround time needed for this testing.

Abstract Image

Abstract Image

Abstract Image

用数据驱动测试设计改进儿科莱姆病测试
诊断的进步没有跟上由伯氏疏螺旋体引起并由蜱虫传播的莱姆病的扩大。莱姆病的临床表现可与许多其他诊断重叠,使莱姆病成为流行地区许多鉴别诊断的重要组成部分。目前的诊断性血液检测依赖于两层算法,第二步要么是耗时的western blot,要么是全细胞裂解免疫测定。这两种第二步测试都不能快速得出这个关键的排除测试的结果。我们假设使用western blot确认信息,我们可以创建计算模型来提出重组二级测试,这将允许更快速、自动化和特定的测试算法。我们在这里提出了一个评估回顾性数据的框架,以确定推定的重组分析成分。使用支持向量机器学习算法对2755份提交用于莱姆病筛查的样本进行回顾性儿科队列评估,以优化Vidas IgG II检测的一级诊断阈值,并确定阳性和阴性确认试验的最佳二级成分。在一级筛查为阴性,但临床怀疑度高的情况下,我们发现1蛋白(L58)可用于减少假阴性结果。对于筛选阳性病例的第二级测试,我们发现6种蛋白质可以使用最终机器学习分类器来减少假阳性结果(L18, L39M, L39, L41, L45和L58)或2种蛋白质使用最终基于规则的方法(L41, L18)。与IgG western blot作为金标准相比,在没有最终机器学习分类器的情况下,所提出的算法的总体准确率为92.36%,在最终算法中集成机器学习分类器的情况下,总体准确率为92.12%。在多个检测方法和机构中使用该框架将允许采用数据驱动的方法进行检测开发,从而为实验室和患者提供该检测所需的周转时间的改进。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Pathology Informatics
Journal of Pathology Informatics Medicine-Pathology and Forensic Medicine
CiteScore
3.70
自引率
0.00%
发文量
2
审稿时长
18 weeks
期刊介绍: The Journal of Pathology Informatics (JPI) is an open access peer-reviewed journal dedicated to the advancement of pathology informatics. This is the official journal of the Association for Pathology Informatics (API). The journal aims to publish broadly about pathology informatics and freely disseminate all articles worldwide. This journal is of interest to pathologists, informaticians, academics, researchers, health IT specialists, information officers, IT staff, vendors, and anyone with an interest in informatics. We encourage submissions from anyone with an interest in the field of pathology informatics. We publish all types of papers related to pathology informatics including original research articles, technical notes, reviews, viewpoints, commentaries, editorials, symposia, meeting abstracts, book reviews, and correspondence to the editors. All submissions are subject to rigorous peer review by the well-regarded editorial board and by expert referees in appropriate specialties.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信