Jin-Ah Sim, Xiaolei Huang, Rachel T Webster, Kumar Srivastava, Kirsten K Ness, Melissa M Hudson, Justin N Baker, I-Chan Huang
{"title":"利用自然语言处理和机器学习表征儿科癌症幸存者的心理压力和生活意义和目的:一项初步验证研究。","authors":"Jin-Ah Sim, Xiaolei Huang, Rachel T Webster, Kumar Srivastava, Kirsten K Ness, Melissa M Hudson, Justin N Baker, I-Chan Huang","doi":"10.1093/jamiaopen/ooaf018","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>To determine if natural language processing (NLP) and machine learning (ML) techniques accurately identify interview-based psychological stress and meaning/purpose data in child/adolescent cancer survivors.</p><p><strong>Materials and methods: </strong>Interviews were conducted with 51 survivors (aged 8-17.9 years; ≥5-years post-therapy) from St Jude Children's Research Hospital. Two content experts coded 244 and 513 semantic units, focusing on attributes of psychological stress (anger, controllability/manageability, fear/anxiety) and attributes of meaning/purpose (goal, optimism, purpose). Content experts extracted specific attributes from the interviews, which were designated as the gold standard. Two NLP/ML methods, Word2Vec with Extreme Gradient Boosting (XGBoost), and Bidirectional Encoder Representations from Transformers Large (BERT<sub>Large</sub>), were validated using accuracy, areas under the receiver operating characteristic curves (AUROCC), and under the precision-recall curves (AUPRC).</p><p><strong>Results: </strong>BERT<sub>Large</sub> demonstrated higher accuracy, AUROCC, and AUPRC in identifying all attributes of psychological stress and meaning/purpose versus Word2Vec/XGBoost. BERT<sub>Large</sub> significantly outperformed Word2Vec/XGBoost in characterizing all attributes (<i>P</i> <.05) except for the purpose attribute of meaning/purpose.</p><p><strong>Discussion: </strong>These findings suggest that AI tools can help healthcare providers efficiently assess emotional well-being of childhood cancer survivors, supporting future clinical interventions.</p><p><strong>Conclusions: </strong>NLP/ML effectively identifies interview-based data for child/adolescent cancer survivors.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 2","pages":"ooaf018"},"PeriodicalIF":2.5000,"publicationDate":"2025-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11936487/pdf/","citationCount":"0","resultStr":"{\"title\":\"Leveraging natural language processing and machine learning to characterize psychological stress and life meaning and purpose in pediatric cancer survivors: a preliminary validation study.\",\"authors\":\"Jin-Ah Sim, Xiaolei Huang, Rachel T Webster, Kumar Srivastava, Kirsten K Ness, Melissa M Hudson, Justin N Baker, I-Chan Huang\",\"doi\":\"10.1093/jamiaopen/ooaf018\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>To determine if natural language processing (NLP) and machine learning (ML) techniques accurately identify interview-based psychological stress and meaning/purpose data in child/adolescent cancer survivors.</p><p><strong>Materials and methods: </strong>Interviews were conducted with 51 survivors (aged 8-17.9 years; ≥5-years post-therapy) from St Jude Children's Research Hospital. Two content experts coded 244 and 513 semantic units, focusing on attributes of psychological stress (anger, controllability/manageability, fear/anxiety) and attributes of meaning/purpose (goal, optimism, purpose). Content experts extracted specific attributes from the interviews, which were designated as the gold standard. Two NLP/ML methods, Word2Vec with Extreme Gradient Boosting (XGBoost), and Bidirectional Encoder Representations from Transformers Large (BERT<sub>Large</sub>), were validated using accuracy, areas under the receiver operating characteristic curves (AUROCC), and under the precision-recall curves (AUPRC).</p><p><strong>Results: </strong>BERT<sub>Large</sub> demonstrated higher accuracy, AUROCC, and AUPRC in identifying all attributes of psychological stress and meaning/purpose versus Word2Vec/XGBoost. BERT<sub>Large</sub> significantly outperformed Word2Vec/XGBoost in characterizing all attributes (<i>P</i> <.05) except for the purpose attribute of meaning/purpose.</p><p><strong>Discussion: </strong>These findings suggest that AI tools can help healthcare providers efficiently assess emotional well-being of childhood cancer survivors, supporting future clinical interventions.</p><p><strong>Conclusions: </strong>NLP/ML effectively identifies interview-based data for child/adolescent cancer survivors.</p>\",\"PeriodicalId\":36278,\"journal\":{\"name\":\"JAMIA Open\",\"volume\":\"8 2\",\"pages\":\"ooaf018\"},\"PeriodicalIF\":2.5000,\"publicationDate\":\"2025-03-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11936487/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"JAMIA Open\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1093/jamiaopen/ooaf018\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/4/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q2\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"JAMIA Open","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/jamiaopen/ooaf018","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/4/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
摘要
目的:确定自然语言处理(NLP)和机器学习(ML)技术是否能准确识别儿童/青少年癌症幸存者基于访谈的心理压力和意义/目的数据。材料与方法:对51例幸存者进行访谈,年龄8-17.9岁;治疗后≥5年)来自St Jude儿童研究医院。两位内容专家编码了244和513个语义单位,重点关注心理压力的属性(愤怒、可控制/可管理、恐惧/焦虑)和意义/目的的属性(目标、乐观、目的)。内容专家从访谈中提取出特定的属性,这些属性被指定为黄金标准。两种NLP/ML方法,Word2Vec with Extreme Gradient Boosting (XGBoost)和双向编码器表示from Transformers Large (BERTLarge),通过准确性、接收者工作特征曲线(AUROCC)下的面积和精确召回率曲线(AUPRC)下的面积进行了验证。结果:与Word2Vec/XGBoost相比,BERTLarge、AUROCC和AUPRC在识别心理压力和意义/目的的所有属性方面表现出更高的准确性。讨论:这些发现表明,人工智能工具可以帮助医疗保健提供者有效地评估儿童癌症幸存者的情绪健康状况,为未来的临床干预提供支持。结论:NLP/ML有效识别基于访谈的儿童/青少年癌症幸存者数据。
Leveraging natural language processing and machine learning to characterize psychological stress and life meaning and purpose in pediatric cancer survivors: a preliminary validation study.
Objective: To determine if natural language processing (NLP) and machine learning (ML) techniques accurately identify interview-based psychological stress and meaning/purpose data in child/adolescent cancer survivors.
Materials and methods: Interviews were conducted with 51 survivors (aged 8-17.9 years; ≥5-years post-therapy) from St Jude Children's Research Hospital. Two content experts coded 244 and 513 semantic units, focusing on attributes of psychological stress (anger, controllability/manageability, fear/anxiety) and attributes of meaning/purpose (goal, optimism, purpose). Content experts extracted specific attributes from the interviews, which were designated as the gold standard. Two NLP/ML methods, Word2Vec with Extreme Gradient Boosting (XGBoost), and Bidirectional Encoder Representations from Transformers Large (BERTLarge), were validated using accuracy, areas under the receiver operating characteristic curves (AUROCC), and under the precision-recall curves (AUPRC).
Results: BERTLarge demonstrated higher accuracy, AUROCC, and AUPRC in identifying all attributes of psychological stress and meaning/purpose versus Word2Vec/XGBoost. BERTLarge significantly outperformed Word2Vec/XGBoost in characterizing all attributes (P <.05) except for the purpose attribute of meaning/purpose.
Discussion: These findings suggest that AI tools can help healthcare providers efficiently assess emotional well-being of childhood cancer survivors, supporting future clinical interventions.
Conclusions: NLP/ML effectively identifies interview-based data for child/adolescent cancer survivors.