Diagnosis最新文献

筛选
英文 中文
Time pressure in diagnosing written clinical cases: an experimental study on time constraints and perceived time pressure. 临床病例书面诊断中的时间压力:关于时间限制和感知时间压力的实验研究。
IF 2.2
Diagnosis Pub Date : 2024-11-28 DOI: 10.1515/dx-2024-0125
Jacky Hooftman, Andrew P J Olson, Casey N McQuade, Sílvia Mamede, Cordula Wagner, Laura Zwaan
{"title":"Time pressure in diagnosing written clinical cases: an experimental study on time constraints and perceived time pressure.","authors":"Jacky Hooftman, Andrew P J Olson, Casey N McQuade, Sílvia Mamede, Cordula Wagner, Laura Zwaan","doi":"10.1515/dx-2024-0125","DOIUrl":"https://doi.org/10.1515/dx-2024-0125","url":null,"abstract":"<p><strong>Objectives: </strong>Time pressure and time constraints have been shown to affect diagnostic accuracy, but how they interact is not clear. The current study aims to investigate the effects of both perceived time pressure (sufficient vs. insufficient time) and actual time constraints (lenient vs. restricted time limit) with regard to diagnostic accuracy.</p><p><strong>Methods: </strong>Residents from two university-affiliated training programs in the USA participated in this online within-subjects experiment. They diagnosed cases under two perceived time pressure conditions: one where they were told they had sufficient time to diagnose the cases and one where they were told they had insufficient time. The actual time limit was either restricted or lenient (± one standard deviation from the mean time to diagnose). Participants provided their most likely diagnosis and a differential diagnosis for each case, and rated their confidence in their most likely diagnosis.</p><p><strong>Results: </strong>A restricted time limit was associated with lower accuracy scores (p=0.044) but no effects of perceived time pressure on diagnostic accuracy were found. However, participants self-reported feeling more time pressure when they thought they had insufficient time (p<0.001). In addition, there was an effect of the actual time limit (p=0.012) and perceived time pressure (p=0.048) on confidence.</p><p><strong>Conclusions: </strong>This study showed that a restricted time limit can negatively affect diagnostic accuracy. Although participants felt more time pressure and were less confident when they thought they had insufficient time, perceived time pressure did not affect diagnostic accuracy. More research is needed to further investigate the effects of time pressure and time limits on diagnostic accuracy.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142726636","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
CDC's Core Elements to promote diagnostic excellence. 疾病预防控制中心促进卓越诊断的核心要素。
IF 2.2
Diagnosis Pub Date : 2024-11-28 DOI: 10.1515/dx-2024-0163
Daniel J Morgan, Hardeep Singh, Arjun Srinivasan, Andrea Bradford, L Clifford McDonald, Preeta K Kutty
{"title":"CDC's Core Elements to promote diagnostic excellence.","authors":"Daniel J Morgan, Hardeep Singh, Arjun Srinivasan, Andrea Bradford, L Clifford McDonald, Preeta K Kutty","doi":"10.1515/dx-2024-0163","DOIUrl":"https://doi.org/10.1515/dx-2024-0163","url":null,"abstract":"<p><p>Nearly a decade after the National Academy of Medicine released the \"Improving Diagnosis in Health Care\" report, diagnostic errors remain common, often leading to physical, psychological, emotional, and financial harm. Despite a robust body of research on potential solutions and next steps, the translation of these efforts to patient care has been limited. Improvement initiatives are still narrowly focused on selective themes such as diagnostic stewardship, preventing overdiagnosis, and enhancing clinical reasoning without comprehensively addressing vulnerable systems and processes surrounding diagnosis. To close this implementation gap, the US Centers for Disease Control and Prevention (CDC) released the Core Elements of Hospital Diagnostic Excellence programs on September 17, 2024. This initiative aligns with the World Health Organization's (WHO) 2024 World Patient Safety Day focus on improving diagnosis. These Core Elements provide guidance for the formation of hospital programs to improve diagnosis and aim to integrate various disparate efforts in hospitals. By creating a shared mental model of diagnostic excellence, the Core Elements of Diagnostic Excellence supports actions to break down silos, guide hospitals toward multidisciplinary diagnostic excellence teams, and provide a foundation for building diagnostic excellence programs in hospitals.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142738784","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Trends of diagnostic adverse events in hospital deaths: longitudinal analyses of four retrospective record review studies. 医院死亡病例中诊断性不良事件的趋势:四项回顾性记录研究的纵向分析。
IF 2.2
Diagnosis Pub Date : 2024-11-27 DOI: 10.1515/dx-2024-0117
Jacky Hooftman, Laura Zwaan, Jonne J Sikkens, Bo Schouten, Martine C de Bruijne, Cordula Wagner
{"title":"Trends of diagnostic adverse events in hospital deaths: longitudinal analyses of four retrospective record review studies.","authors":"Jacky Hooftman, Laura Zwaan, Jonne J Sikkens, Bo Schouten, Martine C de Bruijne, Cordula Wagner","doi":"10.1515/dx-2024-0117","DOIUrl":"https://doi.org/10.1515/dx-2024-0117","url":null,"abstract":"<p><strong>Objectives: </strong>To investigate longitudinal trends in the incidence, preventability, and causes of DAEs (diagnostic adverse events) between 2008 and 2019 and compare DAEs to other AE (adverse event) types.</p><p><strong>Methods: </strong>This study investigated longitudinal trends of DAEs using combined data from four large Dutch AE record review studies. The original four AE studies included 100-150 randomly selected records of deceased patients from around 20 hospitals in each study, resulting in a total of 10,943 patient records. Nurse reviewers indicated cases with potential AEs using a list of triggers. Subsequently, experienced physician reviewers systematically judged the occurrence of AEs, the clinical process in which these AEs occurred, and the preventability and causes.</p><p><strong>Results: </strong>The incidences of DAEs, potentially preventable DAEs and potentially preventable DAE-related deaths initially declined between 2008 and 2012 (2.3 vs. 1.2; OR=0.52, 95 % CI: 0.32 to 0.83), after which they stabilized up to 2019. These trends were largely the same for other AE types, although compared to DAEs, the incidence of other AE types increased between 2016 (DAE: 1.0, other AE types: 8.5) and 2019 (DAE: 0.8, other AE types: 13.0; rate ratio=1.88, 95 % CI: 1.12 to 2.13). Furthermore, DAEs were more preventable (p<0.001) and were associated with more potentially preventable deaths (p=0.016) than other AE types. In addition, DAEs had more and different underlying causes than other AE types (p<0.001). The DAE causes remained stable over time, except for patient-related factors, which increased between 2016 and 2019 (29.5 and 58.6 % respectively, OR=3.40, 95 % CI: 1.20 to 9.66).</p><p><strong>Conclusions: </strong>After initial improvements of DAE incidences in 2012, no further improvement was observed in Dutch hospitals in the last decade. Similar trends were observed for other AEs. The high rate of preventability of DAEs suggest a high potential for improvement, that should be further investigated.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142715666","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A decision support system to increase the compliance of diagnostic imaging examinations with imaging guidelines: focused on cerebrovascular diseases. 提高影像诊断检查符合影像指南的决策支持系统:重点关注脑血管疾病。
IF 2.2
Diagnosis Pub Date : 2024-11-14 DOI: 10.1515/dx-2024-0072
Hamid Moghaddasi, Fatemeh Rahimi, Amir Saied Seddighi, Leila Akbarpour, Arash Roshanpoor
{"title":"A decision support system to increase the compliance of diagnostic imaging examinations with imaging guidelines: focused on cerebrovascular diseases.","authors":"Hamid Moghaddasi, Fatemeh Rahimi, Amir Saied Seddighi, Leila Akbarpour, Arash Roshanpoor","doi":"10.1515/dx-2024-0072","DOIUrl":"https://doi.org/10.1515/dx-2024-0072","url":null,"abstract":"<p><strong>Objectives: </strong>Diagnostic imaging decision support (DI-DS) system has emerged as an innovative evidence-based solution to decrease inappropriate diagnostic imaging. The aim of the present study was to design and evaluate a DI-DS system for cerebrovascular diseases.</p><p><strong>Methods: </strong>The present study was an applied piece of research. First, the conceptual model of the DI-DS system was designed based on its functional and non-functional requirements. Afterwards, to create the system's knowledge base, cerebrovascular diseases diagnostic imaging algorithms were extracted from the American College of Radiology Appropriateness Criteria (ACR-AC). Subsequently, the system was developed based on the obtained conceptual model and the extracted algorithms. The software was programmed by means of the C#. After debugging the system, it was evaluated regarding its performance and also the users' satisfaction with it.</p><p><strong>Results: </strong>Assessing the users' satisfaction with the system demonstrated that all the evaluation criteria met the acceptable threshold (85 %). The retrospective evaluation of the system's performance indicated that from among 76 imaging examinations, which had previously been performed for 30 patients, 12 (15.78 %) were deemed inappropriate. And, the system accurately identified all the inappropriate physicians' decisions. The concurrent evaluation of the system's performance indicated that the system's recommendations helped the physicians remove 100 % (4 out of 4) of the inappropriate and 40 % (2 out of 5) of the inconclusive imaging examinations from their initial choices.</p><p><strong>Conclusions: </strong>A DI-DS system could increase the compliance of the physicians' decisions with diagnostic imaging guidelines, and also improve treatment outcomes through correct diagnosis and providing timely care.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142616781","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Bayesian intelligence for medical diagnosis: a pilot study on patient disposition for emergency medicine chest pain. 用于医疗诊断的贝叶斯智能:关于急诊胸痛患者处置的试点研究。
IF 2.2
Diagnosis Pub Date : 2024-10-25 DOI: 10.1515/dx-2024-0049
Mark W Perlin, Yves-Dany Accilien
{"title":"Bayesian intelligence for medical diagnosis: a pilot study on patient disposition for emergency medicine chest pain.","authors":"Mark W Perlin, Yves-Dany Accilien","doi":"10.1515/dx-2024-0049","DOIUrl":"https://doi.org/10.1515/dx-2024-0049","url":null,"abstract":"<p><strong>Objectives: </strong>Clinicians can rapidly and accurately diagnose disease, learn from experience, and explain their reasoning. Computational Bayesian medical decision-making might replicate this expertise. This paper assesses a computer system for diagnosing cardiac chest pain in the emergency department (ED) that decides whether to admit or discharge a patient.</p><p><strong>Methods: </strong>The system can learn likelihood functions by counting data frequency. The computer compares patient and disease data profiles using likelihood. It calculates a Bayesian probabilistic diagnosis and explains its reasoning. A utility function applies the probabilistic diagnosis to produce a numerical BAYES score for making a medical decision.</p><p><strong>Results: </strong>We conducted a pilot study to assess BAYES efficacy in ED chest pain patient disposition. Binary BAYES decisions eliminated patient observation. We compared BAYES to the HEART score. On 100 patients, BAYES reduced HEART's false positive rate 18-fold from 58.7 to 3.3 %, and improved ROC AUC accuracy from 0.928 to 1.0.</p><p><strong>Conclusions: </strong>The pilot study results were encouraging. The data-driven BAYES score approach could learn from frequency counting, make fast and accurate decisions, and explain its reasoning. The computer replicated these aspects of diagnostic expertise. More research is needed to reproduce and extend these finding to larger diverse patient populations.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142496966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Bringing team science to the ambulatory diagnostic process: how do patients and clinicians develop shared mental models? 将团队科学引入门诊诊断过程:患者和临床医生如何建立共同的心理模型?
IF 2.2
Diagnosis Pub Date : 2024-10-21 DOI: 10.1515/dx-2024-0115
Aubrey Samost-Williams, Eric J Thomas, Olivia Lounsbury, Scott I Tannenbaum, Eduardo Salas, Sigall K Bell
{"title":"Bringing team science to the ambulatory diagnostic process: how do patients and clinicians develop shared mental models?","authors":"Aubrey Samost-Williams, Eric J Thomas, Olivia Lounsbury, Scott I Tannenbaum, Eduardo Salas, Sigall K Bell","doi":"10.1515/dx-2024-0115","DOIUrl":"https://doi.org/10.1515/dx-2024-0115","url":null,"abstract":"<p><p>The ambulatory diagnostic process is potentially complex, resulting in faulty communication, lost information, and a lack of team coordination. Patients and families have a unique position in the ambulatory diagnostic team, holding privileged information about their clinical conditions and serving as the connecting thread across multiple healthcare encounters. While experts advocate for engaging patients as diagnostic team members, operationalizing patient engagement has been challenging. The team science literature links improved team performance with shared mental models, a concept reflecting the team's commonly held knowledge about the tasks to be done and the expertise of each team member. Despite their proven potential to improve team performance and outcomes in other settings, shared mental models remain underexplored in healthcare. In this manuscript, we review the literature on shared mental models, applying that knowledge to the ambulatory diagnostic process. We consider the role of patients in the diagnostic team and adapt the five-factor model of shared mental models to develop a framework for patient-clinician diagnostic shared mental models. We conclude with research priorities. Development, maintenance, and use of shared mental models of the diagnostic process amongst patients, families, and clinicians may increase patient/family engagement, improve diagnostic team performance, and promote diagnostic safety.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142460426","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
From stable teamwork to dynamic teaming in the ambulatory care diagnostic process. 在非住院医疗诊断过程中,从稳定的团队合作到动态的团队合作。
IF 2.2
Diagnosis Pub Date : 2024-10-21 DOI: 10.1515/dx-2024-0108
Scott I Tannenbaum, Eric J Thomas, Sigall K Bell, Eduardo Salas
{"title":"From stable teamwork to dynamic teaming in the ambulatory care diagnostic process.","authors":"Scott I Tannenbaum, Eric J Thomas, Sigall K Bell, Eduardo Salas","doi":"10.1515/dx-2024-0108","DOIUrl":"https://doi.org/10.1515/dx-2024-0108","url":null,"abstract":"<p><p>Dynamic teaming is required whenever people must coordinate with one another in a fluid context, particularly when the fundamental structures of a team, such as membership, priorities, tasks, modes of communication, and location are in near-constant flux. This is certainly the case in the contemporary ambulatory care diagnostic process, where circumstances and conditions require a shifting cast of individuals to coordinate dynamically to ensure patient safety. This article offers an updated perspective on dynamic teaming commonly required during the ambulatory diagnostic process. Drawing upon team science, it clarifies the characteristics of dynamic diagnostic teams, identifies common risk points in the teaming process and the practical implications of these risks, considers the role of providers and patients in averting adverse outcomes, and provides a case example of the challenges of dynamic teaming during the diagnostic process. Based on this, future research needs are offered as well as clinical practice recommendations related to team characteristics and breakdowns, team member knowledge/cognitions, teaming dynamics, and the patient as a team member.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142460427","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Interventions to improve timely cancer diagnosis: an integrative review. 改善癌症及时诊断的干预措施:综合综述。
IF 2.2
Diagnosis Pub Date : 2024-10-18 DOI: 10.1515/dx-2024-0113
Mark L Graber, Bradford D Winters, Roni Matin, Rosann T Cholankeril, Daniel R Murphy, Hardeep Singh, Andrea Bradford
{"title":"Interventions to improve timely cancer diagnosis: an integrative review.","authors":"Mark L Graber, Bradford D Winters, Roni Matin, Rosann T Cholankeril, Daniel R Murphy, Hardeep Singh, Andrea Bradford","doi":"10.1515/dx-2024-0113","DOIUrl":"https://doi.org/10.1515/dx-2024-0113","url":null,"abstract":"<p><p>Cancer will affect more than one in three U.S. residents in their lifetime, and although the diagnosis will be made efficiently in most of these cases, roughly one in five patients will experience a delayed or missed diagnosis. In this integrative review, we focus on missed opportunities in the diagnosis of breast, lung, and colorectal cancer in the ambulatory care environment. From a review of 493 publications, we summarize the current evidence regarding the contributing factors to missed or delayed cancer diagnosis in ambulatory care, as well as evidence to support possible strategies for intervention. Cancer diagnoses are made after follow-up of a positive screening test or an incidental finding, or most commonly, by following up and clarifying non-specific initial presentations to primary care. Breakdowns and delays are unacceptably common in each of these pathways, representing failures to follow-up on abnormal test results, incidental findings, non-specific symptoms, or consults. Interventions aimed at 'closing the loop' represent an opportunity to improve the timeliness of cancer diagnosis and reduce the harm from diagnostic errors. Improving patient engagement, using 'safety netting,' and taking advantage of the functionality offered through health information technology are all viable options to address these problems.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142460333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implementation of a bundle to improve diagnosis in hospitalized patients: lessons learned. 实施捆绑计划以改善住院病人的诊断:经验教训。
IF 2.2
Diagnosis Pub Date : 2024-10-18 DOI: 10.1515/dx-2024-0099
Ashwin Gupta, Martha Quinn, M Todd Greene, Karen E Fowler, Vineet Chopra
{"title":"Implementation of a bundle to improve diagnosis in hospitalized patients: lessons learned.","authors":"Ashwin Gupta, Martha Quinn, M Todd Greene, Karen E Fowler, Vineet Chopra","doi":"10.1515/dx-2024-0099","DOIUrl":"https://doi.org/10.1515/dx-2024-0099","url":null,"abstract":"<p><strong>Objectives: </strong>The inpatient setting is a challenging clinical environment where systems and situational factors predispose clinicians to making diagnostic errors. Environmental complexities limit trialing of interventions to improve diagnostic error in active inpatient clinical settings. Informed by prior work, we piloted a multi-component intervention designed to reduce diagnostic error to understand its feasibility and uptake.</p><p><strong>Methods: </strong>From September 2018 to June 2019, we conducted a prospective, pre-test/post-test pilot study of hospital medicine physicians during admitting shifts at a tertiary-care, academic medical center. Optional intervention components included use of dedicated workspaces, privacy barriers, noise cancelling headphones, application-based breathing exercises, a differential diagnosis expander application, and a checklist to enable a diagnostic pause. Participants rated their confidence in patient diagnoses and completed a survey on intervention component use. Data on provider resource utilization and patient diagnoses were collected, and qualitative interviews were held with a subset of participants in order to better understand experience with the intervention.</p><p><strong>Results: </strong>Data from 37 physicians and 160 patients were included. No intervention component was utilized by more than 50 % of providers, and no differences were noted in diagnostic confidence or number of diagnoses documented pre-vs. post-intervention. Lab utilization increased, but there were no other differences in resource utilization during the intervention. Qualitative feedback highlighted workflow integration challenges, among others, for poor intervention uptake.</p><p><strong>Conclusions: </strong>Our pilot study demonstrated poor feasibility and uptake of an intervention designed to reduce diagnostic error. This study highlights the unique challenges of implementing solutions within busy clinical environments.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142460429","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Validity and reliability of Brier scoring for assessment of probabilistic diagnostic reasoning. 用于评估概率诊断推理的布赖尔评分法的有效性和可靠性。
IF 2.2
Diagnosis Pub Date : 2024-10-16 DOI: 10.1515/dx-2023-0109
Nathan Stehouwer, Anastasia Rowland-Seymour, Larry Gruppen, Jeffrey M Albert, Kelli Qua
{"title":"Validity and reliability of Brier scoring for assessment of probabilistic diagnostic reasoning.","authors":"Nathan Stehouwer, Anastasia Rowland-Seymour, Larry Gruppen, Jeffrey M Albert, Kelli Qua","doi":"10.1515/dx-2023-0109","DOIUrl":"https://doi.org/10.1515/dx-2023-0109","url":null,"abstract":"<p><strong>Objectives: </strong>Educators need tools for the assessment of clinical reasoning that reflect the ambiguity of real-world practice and measure learners' ability to determine diagnostic likelihood. In this study, the authors describe the use of the Brier score to assess and provide feedback on the quality of probabilistic diagnostic reasoning.</p><p><strong>Methods: </strong>The authors describe a novel format called Diagnostic Forecasting (DxF), in which participants read a brief clinical case and assign a probability to each item on a differential diagnosis, order tests and select a final diagnosis. DxF was piloted in a cohort of senior medical students. DxF evaluated students' answers with Brier scores, which compare probabilistic forecasts with case outcomes. The validity of Brier scores in DxF was assessed by comparison to subsequent decision-making in the game environment of DxF, as well as external criteria including medical knowledge tests and performance on clinical rotations.</p><p><strong>Results: </strong>Brier scores were statistically significantly correlated with diagnostic accuracy (95 % CI -4.4 to -0.44) and with mean scores on the National Board of Medical Examiners (NBME) shelf exams (95 % CI -474.6 to -225.1). Brier scores did not correlate with clerkship grades or performance on a structured clinical skills exam. Reliability as measured by within-student correlation was low.</p><p><strong>Conclusions: </strong>Brier scoring showed evidence for validity as a measurement of medical knowledge and predictor of clinical decision-making. Further work must evaluated the ability of Brier scores to predict clinical and workplace-based outcomes, and develop reliable approaches to measuring probabilistic reasoning.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142460334","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信