Min Hee Kim, Silvia Miramontes, Shivani Mehta, Gabriel L Schwartz, Ye Ji Kim, Yulin Yang, Tanisha G Hill-Jarrett, Nicolas Cevallos, Ruijia Chen, M Maria Glymour, Erin L Ferguson, Scott C Zimmerman, Minhyuk Choi, Kendra D Sims
{"title":"Extracting Housing and Food Insecurity Information From Clinical Notes Using cTAKES.","authors":"Min Hee Kim, Silvia Miramontes, Shivani Mehta, Gabriel L Schwartz, Ye Ji Kim, Yulin Yang, Tanisha G Hill-Jarrett, Nicolas Cevallos, Ruijia Chen, M Maria Glymour, Erin L Ferguson, Scott C Zimmerman, Minhyuk Choi, Kendra D Sims","doi":"10.1111/1475-6773.14440","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>To assess the utility and challenges of using natural language processing (NLP) in electronic health records (EHRs) to ascertain health-related social needs (HRSNs) among older adults.</p><p><strong>Study setting and design: </strong>We extracted HRSN information using the NLP system Clinical Text Analysis and Knowledge Extraction System (cTAKES), combined with Concept Unique Identifiers and Systematized Nomenclature for Medicine codes. We validated cTAKES performance, via manual chart review, on two HRSNs: food insecurity, which was included in the healthcare system's HRSN screening tool, and housing insecurity, which was not.</p><p><strong>Data sources and analytic sample: </strong>De-identified EHRs in a large California healthcare system (January 2013 through October 2022) from 119,127 patients aged 55+ in primary and emergency care settings (n = 1,385,259 clinical notes).</p><p><strong>Principal findings: </strong>Although cTAKES had a moderate positive predictive value (77.5%) for housing insecurity, housing challenges among older adults frequently did not align with the concepts the algorithm recognized. cTAKES performed poorly for food insecurity (positive predictive value: 18.5%) because this NLP system incorrectly flagged structured fields from the screening tool.</p><p><strong>Conclusion: </strong>Unstandardized terminology and poor integration of HRSN screeners in EHR remain important barriers to identifying older adults' food and housing insecurity using cTAKES.</p>","PeriodicalId":55065,"journal":{"name":"Health Services Research","volume":" ","pages":"e14440"},"PeriodicalIF":3.1000,"publicationDate":"2025-01-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Health Services Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/1475-6773.14440","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: To assess the utility and challenges of using natural language processing (NLP) in electronic health records (EHRs) to ascertain health-related social needs (HRSNs) among older adults.
Study setting and design: We extracted HRSN information using the NLP system Clinical Text Analysis and Knowledge Extraction System (cTAKES), combined with Concept Unique Identifiers and Systematized Nomenclature for Medicine codes. We validated cTAKES performance, via manual chart review, on two HRSNs: food insecurity, which was included in the healthcare system's HRSN screening tool, and housing insecurity, which was not.
Data sources and analytic sample: De-identified EHRs in a large California healthcare system (January 2013 through October 2022) from 119,127 patients aged 55+ in primary and emergency care settings (n = 1,385,259 clinical notes).
Principal findings: Although cTAKES had a moderate positive predictive value (77.5%) for housing insecurity, housing challenges among older adults frequently did not align with the concepts the algorithm recognized. cTAKES performed poorly for food insecurity (positive predictive value: 18.5%) because this NLP system incorrectly flagged structured fields from the screening tool.
Conclusion: Unstandardized terminology and poor integration of HRSN screeners in EHR remain important barriers to identifying older adults' food and housing insecurity using cTAKES.
期刊介绍:
Health Services Research (HSR) is a peer-reviewed scholarly journal that provides researchers and public and private policymakers with the latest research findings, methods, and concepts related to the financing, organization, delivery, evaluation, and outcomes of health services. Rated as one of the top journals in the fields of health policy and services and health care administration, HSR publishes outstanding articles reporting the findings of original investigations that expand knowledge and understanding of the wide-ranging field of health care and that will help to improve the health of individuals and communities.