NETest®2.0-神经内分泌肿瘤诊断的十年创新

IF 3.3 4区 医学 Q2 ENDOCRINOLOGY & METABOLISM
M. Kidd, I. A. Drozdov, A. Chirindel, G. Nicolas, D. Imagawa, A. Gulati, T. Tsuchikawa, V. Prasad, A. B. Halim, J. Strosberg
{"title":"NETest®2.0-神经内分泌肿瘤诊断的十年创新","authors":"M. Kidd,&nbsp;I. A. Drozdov,&nbsp;A. Chirindel,&nbsp;G. Nicolas,&nbsp;D. Imagawa,&nbsp;A. Gulati,&nbsp;T. Tsuchikawa,&nbsp;V. Prasad,&nbsp;A. B. Halim,&nbsp;J. Strosberg","doi":"10.1111/jne.70002","DOIUrl":null,"url":null,"abstract":"<p>Gastroenteropancreatic neuroendocrine neoplasms (GEP-NENs) are challenging to diagnose and manage. Because there is a critical need for a reliable biomarker, we previously developed the NETest, a liquid biopsy test that quantifies the expression of 51 neuroendocrine tumor (NET)-specific genes in blood using real-time PCR (NETest 1.0). In this study, we have leveraged our well-established laboratory approach (blood collection, RNA isolation, qPCR) with contemporary supervised machine learning methods and expanded training and testing sets to improve the discrimination and calibration of the NETest algorithm (NETest 2.0). qPCR measurements of RNA-stabilized blood-derived gene expression of 51 NET markers were used to train two supervised classifiers. The first classifier trained on 78 Controls and 162 NETs, distinguishing NETs from controls; the second, trained on 134 stable disease samples, 61 progressive disease samples, differentiated stable from progressive NET disease. In all cases, 80% of data was retained for model training, while remaining 20% were used for performance evaluation. The predictive performance of the AI system was assessed using sensitivity, specificity, and Area under Received Operating Characteristic curves (AUROC). The algorithm with the highest performance was retained for validation in two independent validation sets. Validation Cohort #I consisted of 277 patients and 186 healthy controls from the United States, Latin America, Europe, Africa and Asia, while Validation Cohort #II comprised 291 European patients from the Swiss NET Registry. A specificity cohort of 147 gastrointestinal, pancreatic and lung malignancies (non-NETs) was also evaluated. NETest 2.0 Algorithm #1 (Random Forest/gene expression normalized to <i>ATG4B</i>) achieved an AUROC of 0.91 for distinguishing NETs from controls (Validation Cohort #I), with a sensitivity of 95% and specificity of 81%. In Validation Cohort #II, 92% of NETs with image-positive disease were detected. The AUROC for differentiating NETs from other malignancies was 0.95; the sensitivity was 92% and specificity 90%. NETest 2.0 Algorithm #2 (Random Forest/gene expression normalized to <i>ALG9</i>) demonstrated an AUROC of 0.81 in Validation Cohort #I and 0.82 in Validation Cohort #II for differentiating stable from progressive disease, with specificities of 81% and 82%, respectively. Model performance was not affected by gender, ethnicity or age. Substantial improvements in performance for both algorithms were identified in head-to-head comparisons with NETest 1.0 (diagnostic: <i>p</i> = 1.73 × 10<sup>−9</sup>; prognostic: <i>p</i> = 1.02 × 10<sup>−10</sup>). NETest 2.0 exhibited improved diagnostic and prognostic capabilities over NETest 1.0. The assay also demonstrated improved sensitivity for differentiating NETs from other gastrointestinal, pancreatic and lung malignancies. The validation of this tool in geographically diverse cohorts highlights their potential for widespread clinical use.</p>","PeriodicalId":16535,"journal":{"name":"Journal of Neuroendocrinology","volume":"37 4","pages":""},"PeriodicalIF":3.3000,"publicationDate":"2025-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jne.70002","citationCount":"0","resultStr":"{\"title\":\"NETest® 2.0—A decade of innovation in neuroendocrine tumor diagnostics\",\"authors\":\"M. Kidd,&nbsp;I. A. Drozdov,&nbsp;A. Chirindel,&nbsp;G. Nicolas,&nbsp;D. Imagawa,&nbsp;A. Gulati,&nbsp;T. Tsuchikawa,&nbsp;V. Prasad,&nbsp;A. B. Halim,&nbsp;J. Strosberg\",\"doi\":\"10.1111/jne.70002\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Gastroenteropancreatic neuroendocrine neoplasms (GEP-NENs) are challenging to diagnose and manage. Because there is a critical need for a reliable biomarker, we previously developed the NETest, a liquid biopsy test that quantifies the expression of 51 neuroendocrine tumor (NET)-specific genes in blood using real-time PCR (NETest 1.0). In this study, we have leveraged our well-established laboratory approach (blood collection, RNA isolation, qPCR) with contemporary supervised machine learning methods and expanded training and testing sets to improve the discrimination and calibration of the NETest algorithm (NETest 2.0). qPCR measurements of RNA-stabilized blood-derived gene expression of 51 NET markers were used to train two supervised classifiers. The first classifier trained on 78 Controls and 162 NETs, distinguishing NETs from controls; the second, trained on 134 stable disease samples, 61 progressive disease samples, differentiated stable from progressive NET disease. In all cases, 80% of data was retained for model training, while remaining 20% were used for performance evaluation. The predictive performance of the AI system was assessed using sensitivity, specificity, and Area under Received Operating Characteristic curves (AUROC). The algorithm with the highest performance was retained for validation in two independent validation sets. Validation Cohort #I consisted of 277 patients and 186 healthy controls from the United States, Latin America, Europe, Africa and Asia, while Validation Cohort #II comprised 291 European patients from the Swiss NET Registry. A specificity cohort of 147 gastrointestinal, pancreatic and lung malignancies (non-NETs) was also evaluated. NETest 2.0 Algorithm #1 (Random Forest/gene expression normalized to <i>ATG4B</i>) achieved an AUROC of 0.91 for distinguishing NETs from controls (Validation Cohort #I), with a sensitivity of 95% and specificity of 81%. In Validation Cohort #II, 92% of NETs with image-positive disease were detected. The AUROC for differentiating NETs from other malignancies was 0.95; the sensitivity was 92% and specificity 90%. NETest 2.0 Algorithm #2 (Random Forest/gene expression normalized to <i>ALG9</i>) demonstrated an AUROC of 0.81 in Validation Cohort #I and 0.82 in Validation Cohort #II for differentiating stable from progressive disease, with specificities of 81% and 82%, respectively. Model performance was not affected by gender, ethnicity or age. Substantial improvements in performance for both algorithms were identified in head-to-head comparisons with NETest 1.0 (diagnostic: <i>p</i> = 1.73 × 10<sup>−9</sup>; prognostic: <i>p</i> = 1.02 × 10<sup>−10</sup>). NETest 2.0 exhibited improved diagnostic and prognostic capabilities over NETest 1.0. The assay also demonstrated improved sensitivity for differentiating NETs from other gastrointestinal, pancreatic and lung malignancies. The validation of this tool in geographically diverse cohorts highlights their potential for widespread clinical use.</p>\",\"PeriodicalId\":16535,\"journal\":{\"name\":\"Journal of Neuroendocrinology\",\"volume\":\"37 4\",\"pages\":\"\"},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2025-02-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jne.70002\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Neuroendocrinology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/jne.70002\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENDOCRINOLOGY & METABOLISM\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Neuroendocrinology","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/jne.70002","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENDOCRINOLOGY & METABOLISM","Score":null,"Total":0}
引用次数: 0

摘要

胃肠胰神经内分泌肿瘤(GEP-NENs)的诊断和治疗具有挑战性。由于迫切需要一种可靠的生物标志物,我们之前开发了NETest,一种液体活检测试,使用实时PCR (NETest 1.0)量化血液中51种神经内分泌肿瘤(NET)特异性基因的表达。在本研究中,我们利用我们完善的实验室方法(血液采集,RNA分离,qPCR)与当代监督机器学习方法和扩展的训练和测试集,以提高NETest算法(NETest 2.0)的识别和校准。使用qPCR测量51个NET标记物的rna稳定血源性基因表达来训练两个监督分类器。第一个分类器训练了78个control和162个net,将net与control区分开来;第二,对134个稳定型疾病样本和61个进展型疾病样本进行训练,区分稳定型和进展型NET疾病。在所有情况下,80%的数据被保留用于模型训练,而剩下的20%用于性能评估。人工智能系统的预测性能通过灵敏度、特异性和接收工作特征曲线下面积(AUROC)进行评估。将性能最高的算法保留在两个独立的验证集中进行验证。验证队列# 1包括来自美国、拉丁美洲、欧洲、非洲和亚洲的277名患者和186名健康对照,而验证队列#II包括来自瑞士NET注册的291名欧洲患者。对147例胃肠道、胰腺和肺部恶性肿瘤(非nets)的特异性队列也进行了评估。NETest 2.0算法#1(随机森林/基因表达归一化为ATG4B)在区分NETs与对照组(验证队列#I)方面的AUROC为0.91,灵敏度为95%,特异性为81%。在验证队列#II中,检测到92%的net图像阳性疾病。鉴别NETs与其他恶性肿瘤的AUROC为0.95;灵敏度为92%,特异性为90%。NETest 2.0算法#2(随机森林/基因表达归一化为ALG9)在验证队列# 1和验证队列#2中用于区分稳定型和进行性疾病的AUROC分别为0.81和0.82,特异性分别为81%和82%。模特的表现不受性别、种族或年龄的影响。在与NETest 1.0的正面比较中,两种算法的性能都有了实质性的改进(诊断:p = 1.73 × 10-9;预后:p = 1.02 × 10-10)。与nettest1.0相比,nettest2.0表现出更好的诊断和预后能力。该检测还证明了NETs与其他胃肠道、胰腺和肺部恶性肿瘤区分的敏感性提高。该工具在地理上不同的队列中的验证突出了其广泛临床应用的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

NETest® 2.0—A decade of innovation in neuroendocrine tumor diagnostics

NETest® 2.0—A decade of innovation in neuroendocrine tumor diagnostics

Gastroenteropancreatic neuroendocrine neoplasms (GEP-NENs) are challenging to diagnose and manage. Because there is a critical need for a reliable biomarker, we previously developed the NETest, a liquid biopsy test that quantifies the expression of 51 neuroendocrine tumor (NET)-specific genes in blood using real-time PCR (NETest 1.0). In this study, we have leveraged our well-established laboratory approach (blood collection, RNA isolation, qPCR) with contemporary supervised machine learning methods and expanded training and testing sets to improve the discrimination and calibration of the NETest algorithm (NETest 2.0). qPCR measurements of RNA-stabilized blood-derived gene expression of 51 NET markers were used to train two supervised classifiers. The first classifier trained on 78 Controls and 162 NETs, distinguishing NETs from controls; the second, trained on 134 stable disease samples, 61 progressive disease samples, differentiated stable from progressive NET disease. In all cases, 80% of data was retained for model training, while remaining 20% were used for performance evaluation. The predictive performance of the AI system was assessed using sensitivity, specificity, and Area under Received Operating Characteristic curves (AUROC). The algorithm with the highest performance was retained for validation in two independent validation sets. Validation Cohort #I consisted of 277 patients and 186 healthy controls from the United States, Latin America, Europe, Africa and Asia, while Validation Cohort #II comprised 291 European patients from the Swiss NET Registry. A specificity cohort of 147 gastrointestinal, pancreatic and lung malignancies (non-NETs) was also evaluated. NETest 2.0 Algorithm #1 (Random Forest/gene expression normalized to ATG4B) achieved an AUROC of 0.91 for distinguishing NETs from controls (Validation Cohort #I), with a sensitivity of 95% and specificity of 81%. In Validation Cohort #II, 92% of NETs with image-positive disease were detected. The AUROC for differentiating NETs from other malignancies was 0.95; the sensitivity was 92% and specificity 90%. NETest 2.0 Algorithm #2 (Random Forest/gene expression normalized to ALG9) demonstrated an AUROC of 0.81 in Validation Cohort #I and 0.82 in Validation Cohort #II for differentiating stable from progressive disease, with specificities of 81% and 82%, respectively. Model performance was not affected by gender, ethnicity or age. Substantial improvements in performance for both algorithms were identified in head-to-head comparisons with NETest 1.0 (diagnostic: p = 1.73 × 10−9; prognostic: p = 1.02 × 10−10). NETest 2.0 exhibited improved diagnostic and prognostic capabilities over NETest 1.0. The assay also demonstrated improved sensitivity for differentiating NETs from other gastrointestinal, pancreatic and lung malignancies. The validation of this tool in geographically diverse cohorts highlights their potential for widespread clinical use.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Neuroendocrinology
Journal of Neuroendocrinology 医学-内分泌学与代谢
CiteScore
6.40
自引率
6.20%
发文量
137
审稿时长
4-8 weeks
期刊介绍: Journal of Neuroendocrinology provides the principal international focus for the newest ideas in classical neuroendocrinology and its expanding interface with the regulation of behavioural, cognitive, developmental, degenerative and metabolic processes. Through the rapid publication of original manuscripts and provocative review articles, it provides essential reading for basic scientists and clinicians researching in this rapidly expanding field. In determining content, the primary considerations are excellence, relevance and novelty. While Journal of Neuroendocrinology reflects the broad scientific and clinical interests of the BSN membership, the editorial team, led by Professor Julian Mercer, ensures that the journal’s ethos, authorship, content and purpose are those expected of a leading international publication.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信