B. Lambert, W. Galanter, King Lup Liu, Suzanne Falck, G. Schiff, Christine Rash-Foanio, K. Schmidt, Neeha Shrestha, A. Vaida, M. Gaunt
{"title":"Automated detection of wrong-drug prescribing errors","authors":"B. Lambert, W. Galanter, King Lup Liu, Suzanne Falck, G. Schiff, Christine Rash-Foanio, K. Schmidt, Neeha Shrestha, A. Vaida, M. Gaunt","doi":"10.1136/bmjqs-2019-009420","DOIUrl":null,"url":null,"abstract":"Background To assess the specificity of an algorithm designed to detect look-alike/sound-alike (LASA) medication prescribing errors in electronic health record (EHR) data. Setting Urban, academic medical centre, comprising a 495-bed hospital and outpatient clinic running on the Cerner EHR. We extracted 8 years of medication orders and diagnostic claims. We licensed a database of medication indications, refined it and merged it with the medication data. We developed an algorithm that triggered for LASA errors based on name similarity, the frequency with which a patient received a medication and whether the medication was justified by a diagnostic claim. We stratified triggers by similarity. Two clinicians reviewed a sample of charts for the presence of a true error, with disagreements resolved by a third reviewer. We computed specificity, positive predictive value (PPV) and yield. Results The algorithm analysed 488 481 orders and generated 2404 triggers (0.5% rate). Clinicians reviewed 506 cases and confirmed the presence of 61 errors, for an overall PPV of 12.1% (95% CI 10.7% to 13.5%). It was not possible to measure sensitivity or the false-negative rate. The specificity of the algorithm varied as a function of name similarity and whether the intended and dispensed drugs shared the same route of administration. Conclusion Automated detection of LASA medication errors is feasible and can reveal errors not currently detected by other means. Real-time error detection is not possible with the current system, the main barrier being the real-time availability of accurate diagnostic information. Further development should replicate this analysis in other health systems and on a larger set of medications and should decrease clinician time spent reviewing false-positive triggers by increasing specificity.","PeriodicalId":49653,"journal":{"name":"Quality & Safety in Health Care","volume":"28 1","pages":"908 - 915"},"PeriodicalIF":0.0000,"publicationDate":"2019-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1136/bmjqs-2019-009420","citationCount":"7","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Quality & Safety in Health Care","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1136/bmjqs-2019-009420","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 7
Abstract
Background To assess the specificity of an algorithm designed to detect look-alike/sound-alike (LASA) medication prescribing errors in electronic health record (EHR) data. Setting Urban, academic medical centre, comprising a 495-bed hospital and outpatient clinic running on the Cerner EHR. We extracted 8 years of medication orders and diagnostic claims. We licensed a database of medication indications, refined it and merged it with the medication data. We developed an algorithm that triggered for LASA errors based on name similarity, the frequency with which a patient received a medication and whether the medication was justified by a diagnostic claim. We stratified triggers by similarity. Two clinicians reviewed a sample of charts for the presence of a true error, with disagreements resolved by a third reviewer. We computed specificity, positive predictive value (PPV) and yield. Results The algorithm analysed 488 481 orders and generated 2404 triggers (0.5% rate). Clinicians reviewed 506 cases and confirmed the presence of 61 errors, for an overall PPV of 12.1% (95% CI 10.7% to 13.5%). It was not possible to measure sensitivity or the false-negative rate. The specificity of the algorithm varied as a function of name similarity and whether the intended and dispensed drugs shared the same route of administration. Conclusion Automated detection of LASA medication errors is feasible and can reveal errors not currently detected by other means. Real-time error detection is not possible with the current system, the main barrier being the real-time availability of accurate diagnostic information. Further development should replicate this analysis in other health systems and on a larger set of medications and should decrease clinician time spent reviewing false-positive triggers by increasing specificity.
目的:评估一种用于检测电子健康记录(EHR)数据中相似/相似声音(LASA)药物处方错误的算法的特异性。设置城市,学术医疗中心,包括495个床位的医院和门诊诊所,在Cerner电子病历上运行。我们提取了8年的用药单和诊断声明。我们授权了一个药物适应症数据库,对其进行了改进,并将其与药物数据合并。我们开发了一种算法,该算法基于名称相似度、患者接受药物治疗的频率以及诊断声明是否证明药物治疗是合理的,从而触发LASA错误。我们根据相似性对触发器进行分层。两名临床医生审查了一份图表样本,以确定是否存在真正的错误,分歧由第三名审稿人解决。我们计算特异性、阳性预测值(PPV)和产率。结果该算法分析了488 481个订单,生成了2404个触发器(0.5%)。临床医生回顾了506例病例,确认存在61例错误,总体PPV为12.1% (95% CI 10.7%至13.5%)。无法测量灵敏度或假阴性率。该算法的特异性随名称相似度以及预期和分配的药物是否具有相同的给药途径而变化。结论LASA用药错误自动检测是可行的,可以发现目前其他方法无法发现的错误。目前的系统不可能实时检测错误,主要障碍是准确诊断信息的实时可用性。进一步的发展应在其他卫生系统和更多的药物上复制这一分析,并应通过增加特异性来减少临床医生审查假阳性触发因素所花费的时间。