Hao Dai, Elliot B Tapper, Lili Zhao, Grant D Scheiffele, Xiaohan Li, Ronald Ramon, Xing He, Yao An Lee, Jingchuan Guo, Jiang Bian
{"title":"Develop and validate a computable phenotype for identifying alcohol-use disorder patients using structure and unstructured EHR data.","authors":"Hao Dai, Elliot B Tapper, Lili Zhao, Grant D Scheiffele, Xiaohan Li, Ronald Ramon, Xing He, Yao An Lee, Jingchuan Guo, Jiang Bian","doi":"10.1093/alcalc/agaf086","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Alcohol Use Disorder (AUD) drives significant morbidity through alcohol-related liver disease. Accurate AUD identification in electronic health records is critical for research and care delivery, yet International Classification of Diseases (ICD) code-based algorithms miss many cases while manual review is impractical at scale. Computable phenotypes (CPs) integrating structured and unstructured EHR data offer a scalable solution.</p><p><strong>Methods: </strong>Using University of Florida Health's Integrated Data Repository covering two million patients, we developed AUD CPs through a two-step process. First, candidate cohorts were identified using AUD-related ICD codes, medications, and keyword searches across structured and unstructured data. Second, rule-based combinations were iteratively refined through manual chart review. Final algorithms were evaluated against gold-standard chart review, measuring sensitivity, positive predictive value (PPV), and F1-score, then validated in an independent testing set and an external dataset.</p><p><strong>Results: </strong>The F1-optimized CP achieved an F1-score of .87 (sensitivity: .98, PPV: .78) in the testing set, while the precision-optimized CP achieved PPV of .9 (sensitivity: .68, F1-score: .77). Minimal performance attenuation between training and testing sets demonstrated robustness and generalizability. Both CPs substantially outperformed restricted AUD-specific ICD code-based approaches.</p><p><strong>Conclusions: </strong>CPs integrating structured and unstructured EHR data enable accurate, reproducible AUD identification, surpassing traditional AUD-specific ICD-based methods. This approach facilitates efficient cohort construction for clinical research, public health surveillance, and quality improvement initiatives targeting AUD and its consequences, addressing a critical gap in identifying patients who may benefit from screening and intervention.</p>","PeriodicalId":7407,"journal":{"name":"Alcohol and alcoholism","volume":"61 1","pages":""},"PeriodicalIF":2.3000,"publicationDate":"2025-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12779471/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Alcohol and alcoholism","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1093/alcalc/agaf086","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"SUBSTANCE ABUSE","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Alcohol Use Disorder (AUD) drives significant morbidity through alcohol-related liver disease. Accurate AUD identification in electronic health records is critical for research and care delivery, yet International Classification of Diseases (ICD) code-based algorithms miss many cases while manual review is impractical at scale. Computable phenotypes (CPs) integrating structured and unstructured EHR data offer a scalable solution.
Methods: Using University of Florida Health's Integrated Data Repository covering two million patients, we developed AUD CPs through a two-step process. First, candidate cohorts were identified using AUD-related ICD codes, medications, and keyword searches across structured and unstructured data. Second, rule-based combinations were iteratively refined through manual chart review. Final algorithms were evaluated against gold-standard chart review, measuring sensitivity, positive predictive value (PPV), and F1-score, then validated in an independent testing set and an external dataset.
Results: The F1-optimized CP achieved an F1-score of .87 (sensitivity: .98, PPV: .78) in the testing set, while the precision-optimized CP achieved PPV of .9 (sensitivity: .68, F1-score: .77). Minimal performance attenuation between training and testing sets demonstrated robustness and generalizability. Both CPs substantially outperformed restricted AUD-specific ICD code-based approaches.
Conclusions: CPs integrating structured and unstructured EHR data enable accurate, reproducible AUD identification, surpassing traditional AUD-specific ICD-based methods. This approach facilitates efficient cohort construction for clinical research, public health surveillance, and quality improvement initiatives targeting AUD and its consequences, addressing a critical gap in identifying patients who may benefit from screening and intervention.
期刊介绍:
About the Journal
Alcohol and Alcoholism publishes papers on the biomedical, psychological, and sociological aspects of alcoholism and alcohol research, provided that they make a new and significant contribution to knowledge in the field.
Papers include new results obtained experimentally, descriptions of new experimental (including clinical) methods of importance to the field of alcohol research and treatment, or new interpretations of existing results.
Theoretical contributions are considered equally with papers dealing with experimental work provided that such theoretical contributions are not of a largely speculative or philosophical nature.