Yunzhao Xing, Sheng Zhong, Samuel L Aronson, Francisco M Rausa, Dan E Webster, Michelle H Crouthamel, Li Wang
{"title":"基于深度学习的牛皮癣评估:利用临床试验成像准确预测牛皮癣面积严重指数。","authors":"Yunzhao Xing, Sheng Zhong, Samuel L Aronson, Francisco M Rausa, Dan E Webster, Michelle H Crouthamel, Li Wang","doi":"10.1159/000536499","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>Image-based machine learning holds great promise for facilitating clinical care; however, the datasets often used for model training differ from the interventional clinical trial-based findings frequently used to inform treatment guidelines. Here, we draw on longitudinal imaging of psoriasis patients undergoing treatment in the Ultima 2 clinical trial (NCT02684357), including 2,700 body images with psoriasis area severity index (PASI) annotations by uniformly trained dermatologists.</p><p><strong>Methods: </strong>An image-processing workflow integrating clinical photos of multiple body regions into one model pipeline was developed, which we refer to as the \"One-Step PASI\" framework due to its simultaneous body detection, lesion detection, and lesion severity classification. Group-stratified cross-validation was performed with 145 deep convolutional neural network models combined in an ensemble learning architecture.</p><p><strong>Results: </strong>The highest-performing model demonstrated a mean absolute error of 3.3, Lin's concordance correlation coefficient of 0.86, and Pearson correlation coefficient of 0.90 across a wide range of PASI scores comprising disease classifications of clear skin, mild, and moderate-to-severe disease. Within-person, time-series analysis of model performance demonstrated that PASI predictions closely tracked the trajectory of physician scores from severe to clear skin without systematically over- or underestimating PASI scores or percent changes from baseline.</p><p><strong>Conclusion: </strong>This study demonstrates the potential of image processing and deep learning to translate otherwise inaccessible clinical trial data into accurate, extensible machine learning models to assess therapeutic efficacy.</p>","PeriodicalId":11242,"journal":{"name":"Digital Biomarkers","volume":"8 1","pages":"13-21"},"PeriodicalIF":0.0000,"publicationDate":"2024-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10911790/pdf/","citationCount":"0","resultStr":"{\"title\":\"Deep Learning-Based Psoriasis Assessment: Harnessing Clinical Trial Imaging for Accurate Psoriasis Area Severity Index Prediction.\",\"authors\":\"Yunzhao Xing, Sheng Zhong, Samuel L Aronson, Francisco M Rausa, Dan E Webster, Michelle H Crouthamel, Li Wang\",\"doi\":\"10.1159/000536499\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Introduction: </strong>Image-based machine learning holds great promise for facilitating clinical care; however, the datasets often used for model training differ from the interventional clinical trial-based findings frequently used to inform treatment guidelines. Here, we draw on longitudinal imaging of psoriasis patients undergoing treatment in the Ultima 2 clinical trial (NCT02684357), including 2,700 body images with psoriasis area severity index (PASI) annotations by uniformly trained dermatologists.</p><p><strong>Methods: </strong>An image-processing workflow integrating clinical photos of multiple body regions into one model pipeline was developed, which we refer to as the \\\"One-Step PASI\\\" framework due to its simultaneous body detection, lesion detection, and lesion severity classification. Group-stratified cross-validation was performed with 145 deep convolutional neural network models combined in an ensemble learning architecture.</p><p><strong>Results: </strong>The highest-performing model demonstrated a mean absolute error of 3.3, Lin's concordance correlation coefficient of 0.86, and Pearson correlation coefficient of 0.90 across a wide range of PASI scores comprising disease classifications of clear skin, mild, and moderate-to-severe disease. Within-person, time-series analysis of model performance demonstrated that PASI predictions closely tracked the trajectory of physician scores from severe to clear skin without systematically over- or underestimating PASI scores or percent changes from baseline.</p><p><strong>Conclusion: </strong>This study demonstrates the potential of image processing and deep learning to translate otherwise inaccessible clinical trial data into accurate, extensible machine learning models to assess therapeutic efficacy.</p>\",\"PeriodicalId\":11242,\"journal\":{\"name\":\"Digital Biomarkers\",\"volume\":\"8 1\",\"pages\":\"13-21\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-03-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10911790/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Digital Biomarkers\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1159/000536499\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q1\",\"JCRName\":\"Computer Science\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Biomarkers","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1159/000536499","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"Computer Science","Score":null,"Total":0}
引用次数: 0
摘要
简介基于图像的机器学习在促进临床护理方面大有可为;然而,通常用于模型训练的数据集不同于经常用于指导治疗指南的基于干预性临床试验的结果。在此,我们借鉴了Ultima 2临床试验(NCT02684357)中接受治疗的银屑病患者的纵向图像,包括2700张由经过统一培训的皮肤科医生标注了银屑病面积严重程度指数(PASI)的身体图像:我们开发了一种图像处理工作流程,将多个身体区域的临床照片整合到一个模型管道中,我们将其称为 "一步式 PASI "框架,因为它能同时进行身体检测、皮损检测和皮损严重程度分类。我们使用 145 个深度卷积神经网络模型在一个集合学习架构中进行了分组分层交叉验证:结果:表现最好的模型的平均绝对误差为 3.3,Lin's concordance 相关系数为 0.86,Pearson 相关系数为 0.90,适用于广泛的 PASI 分数范围,包括皮肤透明、轻度和中重度疾病分类。对模型性能进行的人内时间序列分析表明,PASI 预测值密切跟踪了从重度到皮肤透明的医生评分轨迹,没有系统性地高估或低估 PASI 评分或与基线相比的百分比变化:这项研究证明了图像处理和深度学习的潜力,可将原本无法获取的临床试验数据转化为准确、可扩展的机器学习模型,以评估疗效。
Deep Learning-Based Psoriasis Assessment: Harnessing Clinical Trial Imaging for Accurate Psoriasis Area Severity Index Prediction.
Introduction: Image-based machine learning holds great promise for facilitating clinical care; however, the datasets often used for model training differ from the interventional clinical trial-based findings frequently used to inform treatment guidelines. Here, we draw on longitudinal imaging of psoriasis patients undergoing treatment in the Ultima 2 clinical trial (NCT02684357), including 2,700 body images with psoriasis area severity index (PASI) annotations by uniformly trained dermatologists.
Methods: An image-processing workflow integrating clinical photos of multiple body regions into one model pipeline was developed, which we refer to as the "One-Step PASI" framework due to its simultaneous body detection, lesion detection, and lesion severity classification. Group-stratified cross-validation was performed with 145 deep convolutional neural network models combined in an ensemble learning architecture.
Results: The highest-performing model demonstrated a mean absolute error of 3.3, Lin's concordance correlation coefficient of 0.86, and Pearson correlation coefficient of 0.90 across a wide range of PASI scores comprising disease classifications of clear skin, mild, and moderate-to-severe disease. Within-person, time-series analysis of model performance demonstrated that PASI predictions closely tracked the trajectory of physician scores from severe to clear skin without systematically over- or underestimating PASI scores or percent changes from baseline.
Conclusion: This study demonstrates the potential of image processing and deep learning to translate otherwise inaccessible clinical trial data into accurate, extensible machine learning models to assess therapeutic efficacy.