Performance of Predefined Search Patterns for Identifying Documented Goals-of-Care Discussions in Inpatient Electronic Health Records.

IF 2.2 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES
Robert Y Lee, Alison M Uyeda, Kevin S Li, James Sibley, Trevor Cohen, William B Lober, Danae G Dotolo, Ruth A Engelberg, Erin K Kross
{"title":"Performance of Predefined Search Patterns for Identifying Documented Goals-of-Care Discussions in Inpatient Electronic Health Records.","authors":"Robert Y Lee, Alison M Uyeda, Kevin S Li, James Sibley, Trevor Cohen, William B Lober, Danae G Dotolo, Ruth A Engelberg, Erin K Kross","doi":"10.1089/jpm.2024.0496","DOIUrl":null,"url":null,"abstract":"<p><p><b><i>Objective:</i></b> To characterize the sensitivity and predictive value of predefined search terms for identifying documented goals-of-care discussions in health records of hospitalized patients with serious illness. <b><i>Methods:</i></b> We evaluated the performance of 30 previously published and investigator-defined search terms codified into regular expressions (a type of pattern-based text search) in detecting goals-of-care documentation in a 2974-note corpus of electronic health record notes belonging to 159 inpatients enrolled in a U.S. clinical trial over 2020-2021. <b><i>Results:</i></b> Compared to conventional chart abstraction, search terms for \"goals of care\" and synonyms such as \"GOC\" had poor sensitivity (range: 29.5-38.3%) and modest positive predictive value (PPV; range: 48.3-61.7%) for identifying notes with goals-of-care documentation. Combinations of search terms demonstrated modest performance (sensitivity 62.0%, PPV 59.4%, F<sub>1</sub> 0.61) but fell short of more complex natural language processing models. <b><i>Conclusion:</i></b> In certain contexts, predefined regular-expression-based search terms may have suboptimal sensitivity and predictive value for identifying documented goals-of-care discussions.</p>","PeriodicalId":16656,"journal":{"name":"Journal of palliative medicine","volume":" ","pages":""},"PeriodicalIF":2.2000,"publicationDate":"2025-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of palliative medicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1089/jpm.2024.0496","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

Objective: To characterize the sensitivity and predictive value of predefined search terms for identifying documented goals-of-care discussions in health records of hospitalized patients with serious illness. Methods: We evaluated the performance of 30 previously published and investigator-defined search terms codified into regular expressions (a type of pattern-based text search) in detecting goals-of-care documentation in a 2974-note corpus of electronic health record notes belonging to 159 inpatients enrolled in a U.S. clinical trial over 2020-2021. Results: Compared to conventional chart abstraction, search terms for "goals of care" and synonyms such as "GOC" had poor sensitivity (range: 29.5-38.3%) and modest positive predictive value (PPV; range: 48.3-61.7%) for identifying notes with goals-of-care documentation. Combinations of search terms demonstrated modest performance (sensitivity 62.0%, PPV 59.4%, F1 0.61) but fell short of more complex natural language processing models. Conclusion: In certain contexts, predefined regular-expression-based search terms may have suboptimal sensitivity and predictive value for identifying documented goals-of-care discussions.

用于识别住院患者电子健康记录中记录的护理目标讨论的预定义搜索模式的性能。
目的:描述识别严重疾病住院患者健康记录中记录的护理目标讨论的预定义搜索词的敏感性和预测值。方法:我们评估了30个先前发表的和研究者定义的搜索词的性能,这些搜索词被编码成正则表达式(一种基于模式的文本搜索),用于检测电子健康记录笔记的2974个笔记语料库中的护理目标文档,这些笔记属于2020-2021年期间参加美国临床试验的159名住院患者。结果:与传统的图表抽象相比,“护理目标”和“GOC”等搜索词的敏感性较差(范围:29.5-38.3%),阳性预测值(PPV;范围:48.3-61.7%)用于识别带有护理目标文件的笔记。搜索词组合表现出适度的性能(敏感度62.0%,PPV 59.4%, F1 0.61),但低于更复杂的自然语言处理模型。结论:在某些情况下,预定义的基于正则表达式的搜索词在识别记录的护理目标讨论方面可能具有次优的灵敏度和预测价值。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of palliative medicine
Journal of palliative medicine 医学-卫生保健
CiteScore
3.90
自引率
10.70%
发文量
345
审稿时长
2 months
期刊介绍: Journal of Palliative Medicine is the premier peer-reviewed journal covering medical, psychosocial, policy, and legal issues in end-of-life care and relief of suffering for patients with intractable pain. The Journal presents essential information for professionals in hospice/palliative medicine, focusing on improving quality of life for patients and their families, and the latest developments in drug and non-drug treatments. The companion biweekly eNewsletter, Briefings in Palliative Medicine, delivers the latest breaking news and information to keep clinicians and health care providers continuously updated.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信