Robert Y Lee, Alison M Uyeda, Kevin S Li, James Sibley, Trevor Cohen, William B Lober, Danae G Dotolo, Ruth A Engelberg, Erin K Kross
{"title":"Performance of Predefined Search Patterns for Identifying Documented Goals-of-Care Discussions in Inpatient Electronic Health Records.","authors":"Robert Y Lee, Alison M Uyeda, Kevin S Li, James Sibley, Trevor Cohen, William B Lober, Danae G Dotolo, Ruth A Engelberg, Erin K Kross","doi":"10.1089/jpm.2024.0496","DOIUrl":null,"url":null,"abstract":"<p><p><b><i>Objective:</i></b> To characterize the sensitivity and predictive value of predefined search terms for identifying documented goals-of-care discussions in health records of hospitalized patients with serious illness. <b><i>Methods:</i></b> We evaluated the performance of 30 previously published and investigator-defined search terms codified into regular expressions (a type of pattern-based text search) in detecting goals-of-care documentation in a 2974-note corpus of electronic health record notes belonging to 159 inpatients enrolled in a U.S. clinical trial over 2020-2021. <b><i>Results:</i></b> Compared to conventional chart abstraction, search terms for \"goals of care\" and synonyms such as \"GOC\" had poor sensitivity (range: 29.5-38.3%) and modest positive predictive value (PPV; range: 48.3-61.7%) for identifying notes with goals-of-care documentation. Combinations of search terms demonstrated modest performance (sensitivity 62.0%, PPV 59.4%, F<sub>1</sub> 0.61) but fell short of more complex natural language processing models. <b><i>Conclusion:</i></b> In certain contexts, predefined regular-expression-based search terms may have suboptimal sensitivity and predictive value for identifying documented goals-of-care discussions.</p>","PeriodicalId":16656,"journal":{"name":"Journal of palliative medicine","volume":" ","pages":""},"PeriodicalIF":2.2000,"publicationDate":"2025-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of palliative medicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1089/jpm.2024.0496","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: To characterize the sensitivity and predictive value of predefined search terms for identifying documented goals-of-care discussions in health records of hospitalized patients with serious illness. Methods: We evaluated the performance of 30 previously published and investigator-defined search terms codified into regular expressions (a type of pattern-based text search) in detecting goals-of-care documentation in a 2974-note corpus of electronic health record notes belonging to 159 inpatients enrolled in a U.S. clinical trial over 2020-2021. Results: Compared to conventional chart abstraction, search terms for "goals of care" and synonyms such as "GOC" had poor sensitivity (range: 29.5-38.3%) and modest positive predictive value (PPV; range: 48.3-61.7%) for identifying notes with goals-of-care documentation. Combinations of search terms demonstrated modest performance (sensitivity 62.0%, PPV 59.4%, F1 0.61) but fell short of more complex natural language processing models. Conclusion: In certain contexts, predefined regular-expression-based search terms may have suboptimal sensitivity and predictive value for identifying documented goals-of-care discussions.
目的:描述识别严重疾病住院患者健康记录中记录的护理目标讨论的预定义搜索词的敏感性和预测值。方法:我们评估了30个先前发表的和研究者定义的搜索词的性能,这些搜索词被编码成正则表达式(一种基于模式的文本搜索),用于检测电子健康记录笔记的2974个笔记语料库中的护理目标文档,这些笔记属于2020-2021年期间参加美国临床试验的159名住院患者。结果:与传统的图表抽象相比,“护理目标”和“GOC”等搜索词的敏感性较差(范围:29.5-38.3%),阳性预测值(PPV;范围:48.3-61.7%)用于识别带有护理目标文件的笔记。搜索词组合表现出适度的性能(敏感度62.0%,PPV 59.4%, F1 0.61),但低于更复杂的自然语言处理模型。结论:在某些情况下,预定义的基于正则表达式的搜索词在识别记录的护理目标讨论方面可能具有次优的灵敏度和预测价值。
期刊介绍:
Journal of Palliative Medicine is the premier peer-reviewed journal covering medical, psychosocial, policy, and legal issues in end-of-life care and relief of suffering for patients with intractable pain. The Journal presents essential information for professionals in hospice/palliative medicine, focusing on improving quality of life for patients and their families, and the latest developments in drug and non-drug treatments.
The companion biweekly eNewsletter, Briefings in Palliative Medicine, delivers the latest breaking news and information to keep clinicians and health care providers continuously updated.